Menu Close

Category: journalism

Chapter 3: The Rise of Computer-Assisted Reporting by Brant Houston

Embed from Getty Images
The third chapter in Partners for Preservation is ‘The Rise of Computer-Assisted Reporting: Challenges and Successes’ by Brant Houston. A chapter on this topic has been at the top of my list of chapter ideas from the very start of this project. Back in February of 2007, Professor Ira Chinoy from the University of Maryland, College Park’s Journalism Department spoke to my graduate school Archival Access class. His presentation and the related class discussion led to my blog post Understanding Born-Digital Records: Journalists And Archivists With Parallel Challenges. Elements of this blog post even inspired a portion of the book’s introduction.

The photo above is from the 1967 Detroit race riots. 50 years ago, the first article recognized to have used computer-assisted reporting was awarded the 1968 Pulitzer Prize for Local General or Spot News Reporting “For its coverage of the Detroit riots of 1967, recognizing both the brilliance of its detailed spot news staff work and its swift and accurate investigation into the underlying causes of the tragedy.” In his chapter, Brant starts here and takes us through the evolution of computer-assisted reporting spanning from 1968 to the current day, and looking forward to the future.

As the third chapter in Part 1: Memory, Privacy, and Transparency, it continues to weave these three topics together. Balancing privacy and the goal of creating documentation to preserve memories of all that is going on around us is not easy. Transparency and a strong commitment to ethical choices underpin the work of both journalists and archivists.

This is one of my favorite passages:

“As computer-assisted repoting has become more widespread and routine, it has given rise to discussion and debate over the issues regarding the ethical responsibilitys of journalists. There have been criticisms over the publishing of data that was seen as intrusive and violating the privacy of individuals.”

I learned so much in this chapter about the long road journalists had to travel as they sought to use computers to support their reporting. It never occurred to me, as someone who has always had the access to the computing power I needed through school or work, that getting the tools journalists needed to do their computational analysis often required negotiation for time on newspaper mainframes or seeking partners outside of the newsroom. It took tenacity and the advent of personal computers to make computer-assisted reporting feasible for the broader community of journalists around the world.

Journalists have sought the help of archivists on projects for many years – seeking archival records as part of the research for their reporting. Now journalists are also taking steps to preserve their field’s born-digital content. Given the high percentage of news articles that exist exclusively online – projects like the Journalism Digital News Archive are crucial to the survival of these articles. I look forward to all the ways that our fields can learn from each other and work together to tackle the challenges of digital preservation.

Bio

Brant Houston

Brant Houston is the Knight Chair in Investigative Reporting at the University of Illinois at Urbana-Champaign where he works on projects and research involving the use of data analysis in journalism. He is co-founder of the Global Investigative Journalism Network and the Institute for Nonprofit News. He is author of Computer-Assisted Reporting: A Practical Guide, co-author of The Investigative Reporter’s Handbook. He is a contributor to books on freedom of information acts and open government. Before joining the University of Illinois, he was executive director of Investigative Reporters and Editors at the University of Missouri after being an award-winning investigative journalist for 17 years.  

 

Sunshine Week 2009: Archives, Records and Other Online Government Information

Sunshine Week Sunshine Week 2009 is a national initiative spearheaded by journalists to “open a dialogue about the importance of open government and freedom of information”. The Electronic Frontier Foundation (EFF) chose to mark Sunshine Week this year by announcing the release their new tool for searching EFF’s FOIA documents. Learn more about EFF’s efforts to make open government a reality in this EFF call to action.

The Sunshine Week blog announced the release of a 2009 Survey Of State Government Information Online. The survey results explains:

Using a standardized worksheet surveyors rated each section on its usability, looking at factors such as whether the information was clearly linked, if full reports or only summaries were available, whether viewing and/or downloading was free, and whether the data were current. The categories for the survey were selected for generally serving the overall public good — the kind of information people need for their own health and well-being and that of the community.

See the worksheet for details on the categories selected for inclusion in the survey and the results for lots of interesting tidbits about exactly which states provide access (or not) to various public information online. A few very randomly selected highlights:

  • Maryland: Nursing home information, mhcc.maryland.gov/consumerinfo/nhguide, got high marks for facilitating online search and for allowing users to “compare data in a variety of ways.”
  • Iowa: The state auditor’s office reportedly offers online more than 5,000 full reports of all its audits dating back to 2001. The audits are easily accessible from tabs on the main Web page, www.auditor.iowa.gov.
  • Colorado: Bridge inspection reports in Colorado are considered public, but they are not published online. Anyone who wants to see the reports is advised to file an FOI request.

All of this made me recall my blog post about the parallel goals of journalists and archivists when considering digital public records and databases. I wanted to celebrate Sunshine Week by looking for other online sources of government information. My first stop was the website of the Council of State Archivists (CoSA). They had a couple of great resources including:

A bit further afield we find GovernmentDocs.org advertised as a “community government document reviewer system”. On their about page we read:

With the GovernmentDocs.org system, citizen reviewers can engage in the government accountability process like never before. Registered users can review and comment on documents, adding their insights and expertise to the work of the national nonprofit organizations which are partnering on this project. This new information then becomes instantly searchable. The text of each document is searchable, as well, thanks to a powerful Optical Character Recognition (OCR) functionality.

GovernmentDocs.org adds a powerful layer to government transparency and accountability by indexing documents in a user-friendly manner that is remarkably easy to share. Every page of every document has its own unique url, allowing you and other users to link to that page on blogs, send emails about the documents to friends, and expose the information to a wider audience.

Here is an example GovernmentDocs page taken from a request submitted by CREW (Citizens for Responsibility and Ethics in Washington) regarding the Endangered Species Act. Each GovernmentDocs page has a unique URL, full text transcription of the page and supports comments and reviews. The possibility of building up a community around these records is very real. I am curious to see how many citizen reviewers and comments are associated with these documents a year from now.

Please help celebrate Sunshine Week by exploring all these amazing resources!

Google Tackles Magazine Archives

Google Book Search: Popular Mechanics Jan 1905 Cover ImageAs has been reported around the web today, Google is now digitizing and adding magazines to Google Book Search. This follows on the tails of the recent Google Life Photo archive announcement.

I took a look around to see what I could see. I was intrigued by the fact that I couldn’t see a list of all the magazines in their collection. So I went after the information the hard way and kept reloading the Google Book Search home page until I didn’t see any new titles displayed in their highlighted magazine section. This is what I came up with, roughly grouped by general topic groupings.

Science and technology:

Lifestyle and city themed:

African American:

  • Ebony Jr!: May 1973 through October 1985
  • Jet: November 1961 through October 2008
  • Black Digest: Named ‘Negro Digest’ from November 1961 through April 1970, then Black Digest from May 1970 through April 1976.

Health, nutrition and organic:

  • Women’s Health and Men’s Health: January 2006 through present. I found it very amusing to be able to scan the covers of all the issues so easily – true for all of these magazines of course, but funny to see cover after cover of almost identically clad men and women exercising.
  • Prevention: January 2006 through the present
  • Better Nutrition: January 1999 through December 2004
  • Organic Gardening: November 2005 to the present
  • Vegetarian Times: March1981 through November 2004

Sports and the outdoors:

They of course promise more magazines on the way, so if you are reading this long after mid December 2008  I would assume there are more magazines and more issues available now. I hope that they make it easier to browse just magazines. Once they have a broader array of titles – how neat would it be to build a virtual news stand for a specific week in history? Shouldn’t be hard – they have all the metadata and cover images they need.

I love being able to read the magazine – advertising and all. They display the covers in batches by decade or 5 year period depending on the number of issues. I also like the Google map provided on each magazines ‘about’ page that shows ‘Places mentioned in this magazine’ and easily links you directly to the article that mentions the location marked on the map.

I think it is interesting that Google went with more of a PDF single scrolling model rather than an interface that mimics turning pages. In many issues (maybe all?) they have hot-linked the table of contents so that you can scroll down to that section instantly. You can also search within the magazine, though from my short experiments it seems that only the articles are text indexed and the advertisements are not.

Google’s current model for search is to return results for magazines mixed in with books in Google Book Search results – but they do let you limit your results to only magazines from their Advanced Search page within Google Book Search. See these results for a quick search on sunscreen in magazines.

Overall I mark this as a really nice step forward in access to old magazines. As with many visualizations, seeing the about page for any of these magazines made me ask myself new questions.  It will be interesting to see how many magazines sign on to be included and how the interface evolves.

To read more about Google’s foray into magazine digitization and search take a look at:

For a really nice analysis of the information that Google provides on the magazine pages see Search Engine Land’s Google Book Search Puts Magazines Online.

Video News Archives: Digitization as Good Business

Flickr: OSU Spring Game 2006 Media Lineup by Chris MetcalfMy work now includes more SEO (Search Engine Optimization) work and so I have added SEO focused blogs to my RSS feedreader. Today I spotted Search Engine Land‘s post Business Opportunities For Video News Archives. Stephen Baker calculates that 35 years worth of archive footage equals 51,100 hours of content per station. With approximately 20 stations per broadcast group he estimates a cost of $30 million per group to digitize each broadcast group’s archive of news footage. See the original article for more details on his calculations.

He then proposes 3 approaches to monetizing these efforts and leveraging the resulting digitized video:

  1. Media-Centric Wikipedia – complete with an expectation that social media contributions would provide “scalable way for creating editorial metadata, such as descriptions and story summaries that would be costly to otherwise create”. This makes me think of Flickr Commons for video.
  2. Education Site – akin to NBCU’s iCue site I mentioned in my post about NBC News Archive footage on Hulu. “Efforts like this provide educational/subscription opportunities as well as sponsorship/advertising opportunities—what advertiser doesn’t want to get in front of 13 – 18 year olds?”
  3. News Site Extension – described as “bolting the news archive onto the existing site”. The major benefit of this is that “more content provides more SEO opportunity and, hence, larger audience reach.”

Baker concludes:

In a market where traditional media is struggling to create unique and compelling online experiences and business models, the archive represent a differentiator that can jump-start audience building and monetization initiatives. Not only is it an important representation of world history that must be saved for “preservation-sake”, the archive represents a large, untapped online opportunity.  Who will be first to realize its potential?

The ultimate goal of all three of these scenarios is to offset the extreme expense of digitization of thousands of hours of news footage. I think it is refreshing to see a perspective from outside the cultural heritage corner of the world that still sees video archives as rich resources worth preserving. I also like seeing ideas that are pitched in manner that should catch the attention of those making budgets and struggling with finding funding for large digitization efforts.

Image Credit: Flickr photo OSU Spring Game 2006 Media Lineup by Chris Metcalf

Political Campaign Ads from the NBC News Archives Find New Audience on Hulu.com

Thinking about politics, but waxing nostalgic for the good old days of movie stars and snappy jingles? Surf over to Hulu.com’s new gallery of Historic Campaign Ads. These are from iCue, which bills itself as “A fun, innovative learning environment built around the video from the NBC News Archives“.

And what would a political video blog post be without a political video? If you don’t see the video below, you can click through to view the I Like Ike ad from 1954 I chose for your viewing pleasure.

This is a great example of finding new audiences for material from archives. In this case, I had to dig for a while to discover that these were from the NBC News Archives. The Hulu iCue network/studio home page doesn’t really tell me anything – but you can imagine using a page like this to supply more information if you wanted to stress the archival origin of a set of videos.

Vice President Ruled Part of Executive Branch: Cheney’s Records Must Be Preserved

CNN’s headline is Cheney must keep records, judge orders.  The very short version of all this is that the Citizens for Responsibility and Ethics in Washington (CREW) sued “Vice President Richard B. Cheney in his official capacity, the Executive Office of the President (“EOP”), the Office of the Vice President (“OVP”), the National Archives and Records
Administration (“NARA”), and Dr. Allen Weinstein, Archivist of the United States, in his official capacity” to force everyone involved to “preserve all vice presidential records, broadly defined to encompass all records relating to the vice president carrying out his constitutional, statutory or other official or ceremonial duties” (see the CREW site article: Court Orders Cheney to Preserve Records in CREW Lawsuit).

Turns out that a judge agrees with CREW and has ordered that:

Defendants shall preserve throughout the pendency of this litigation all documentary material, or any reasonably segregable portion thereof created or received by the Vice President, his staff, or a unit or individual of the Office of the Vice President whose function is to advise and assist the Vice President, in the course of conducting activities which relate to or have an effect upon the carrying out of the constitutional, statutory, or other official or ceremonial duties of the Vice President, without regard to any limiting definitions that Defendants may believe are appropriate

I love that last bit – keep it all, even if you don’t think you should.  The court order finishes by saying that they should still give the records to NARA as long as NARA is going to treat them as covered by the Presidential Records Act (see NARA’s PRA page or Wikipedia’s PRA page – I will let you guess which is easier to read).

Is it bad of me to be excited that this is being treated as front page news? As of 9:30pm September 20th 2008, CNN is featuring the article in its ‘prime top left with a big photo’ spot and the New York Times has a link off the main page to their article: Cheney Is Ordered to Preserve Wide Set of Records. They say that there is no such thing as bad publicity. I would like to believe that front page news stories such as this one help improve understanding of archives in general (and NARA in particular).

Using WWI Draft Registration Cards for Research: NARA Records Provide Crucial Data

NARA:   	 World War I photograph, 1918 (ARC Identifier: 285374)

In the HealthDay article Having Lots of Kids Helps Dads Live to 100, a recent study was described that examined what increased the chances of a man living past 100.

A young, trim farmer with four or more children: According to a new study, that’s the ideal profile for American men hoping to reach 100 years of age. The research, based largely on data from World War I draft cards, suggests that keeping off excess weight in youth, farming and fathering a large number of offspring all help men live past a century.

The article mentions that this research was “spurred by the fact that a treasure trove of information about 20th-century American males has now been put online”. The study was based out of the University of Chicago’s Center on Aging. The paper, New Findings on Human Longevity Predictors, includes the following reference:

Banks, R. (2000). World War I Civilian Draft Registrations. [database on-line]. Provo, UT, Ancestry.com.

With an account on Ancestry.com, you too could examine the online database of World War I Draft Registration Cards. This Ancestry.com page notes the source of the original data as:

United States, Selective Service System. World War I Selective Service System Draft Registration Cards, 1917-1918. Washington, D.C.: National Archives and Records Administration. M1509, 4,582 rolls

NARA’s page for the World War I Selective Service System Draft Registration Cards, M1509 includes similar background information to what can be found on the Ancestry.com page, but of course – no access to the actual records.

It is frustrating to a study based on archival records that is making the news, but that does not make it clear to the reader that archival records were the source for the research. As I discussed at length in my post Epidemiological Research and Archival Records: Source of Records Used for Research Fails to Make the News, I feel that it is very important to take every opportunity to help the general public understand how archival records are supporting research that impacts our understanding of the world around us. I appreciate that partnering with 3rd parties to get government records digitized is often the only option – but I want people to be clear about why those records still exist in the first place.

Photo Credit: US. National Archives, World War I Photographs, 1918. Army photographs. Battle of St. Mihiel-American Engineers returning from the front; tank going over the top; group photo of the 129th Machine gun Battalion, 35th Division before leaving for the front; views of headquarters of the 89th Division next to destroyed bridge; Company E, 314th Engineers, 89th Division, and making rolling barbed wire entanglements. NAIL Control Number: NRE-75-HAS(PHO)-65

October is American Archives Month

SAA American Archives MonthWith barely more than a week to go, I am finally getting my act together to mention American Archives Month. To check if there are activities somewhere near you, go to the very thorough Council of State Archivists listing of activities for American Archives Month 2007. If you love looking at posters take a look at their awsome Archives Week/Month Poster Gallery.

The Society of American Archivists came out with a great array of resources in support of the celebration this year. I especially like the How To Know If Something Is Newsworthy and Tips for Media Interviews fliers – but if you download only one document to look through – make it the American Archives Month Public Relations Kit. They get to the heart of one of my favorite sentiments – keep archival records in front of the eyes of the everyday person. I don’t mean that in a sensational way… I don’t want archives in the news for screwing up (even if they do say that any publicity is good publicity). I want every news story that could have the support of archival records to use them and acknowledge them. I want every middle school kid who lives in a town with an archives to know that it exists and to have some idea why they should care. I want every teacher who has an archives with an enthusiastic archivist in it near them to KNOW about that enthusiastic archivist and use the available resources to make their lessons richer.

American Archives Month is a great vehicle for reaching out and pulling people in the doors. It could also be used as an opportunity for archives to try new programs and judge their popularity before rolling out sessions to be held throughout the year.

Finally – another way to get a sense of what is happening locally is to keep an eye on at what other blogs are posting about American Archives Month 2007.

Controversial Photos, Archvists’ Choices and Journalism

New York Times Magazine Cover: January 1995The New York Times Magazine published The Great Ivy League Nude Posture Photo Scandal in January of 1995. Still available online, it is a fascinating tale that took reporter Ron Rosenbaum on a wild hunt through multiple archives in a quest for long lost photographs. I spotted a link to the article in a post on Boing Boing – and once I started reading it I couldn’t stop.

The story includes thorough coverage of the research (and the footwork and the paperwork) it took to find the final resting place of some very controversial photographs. Taken as part of the orientation process of new students at Ivy League and Seven Sisters school campuses predominately during the 1940’s, 50’s and 60’s, these photos were theoretically taken to screen for students who needed remedial posture classes. William Herbert Sheldon was a driving force behind many of the photos. Best known for assigning people into three categories of body types in the 1940s, Sheldon based his categories of endomorphic, mesomorphic, and ectomorphic on measurements done using the student photographs. Rosenbaum’s quest was to find the real story behind the photos and to discover if any of the photos survived the purging fires at that occurred at many of the schools involved.

His first stop was Harvard’s archives:

Harley P. Holden, curator of Harvard’s archives, said that from the 1880’s to the 1940’s the university had its own posture-photo program in which some 3,500 pictures of its students were taken. Most were destroyed 15 or 20 years ago “for privacy scruples,” Holden said. Nonetheless, quite a few Harvard nudes can be found illustrating Sheldon’s book on body types, the Atlas of Men. Radcliffe took posture photos from 1931 to 1961; the curator there said that most of them had been destroyed (although some might be missing) and that none were taken by Sheldon.

A major turning point in Sheldon’s project came in 1950. He went to the University of Washington to further his plans to make an Altas of Women. The families of a few photographed females students at the university questioned the real purpose of the photographs. The resulting upheaval culminated in the destruction of many photographs. A Time article dated September 25, 1950, Revolt at Washington, documents the events in Washington and notes that over 800 photos were burned.

Rosenbaum’s article goes on mention that thousands of photos were subsequently burned at Harvard, Vassar and Yale in the 60’s and 70’s – but he continued to hunt for the ones that some believed had escaped into Sheldon’s private archives. A chain of contacts led Rosenbaum to Sheldon’s former associate Roland D. Elderkin. An elderly gentleman of 84 at the time of the story’s publication, Elderkin spent years assisting Sheldon. He took many of the photographs. And after being turned down by many archives, he found Sheldon’s records, photos and negatives a home in the National Anthropological Archives.

In 1987, the curators of the National Anthropological Archives acquired the remains of Sheldon’s life work, which were gathering dust in “dead storage” in a Goodwill warehouse in Boston. While there were solid archival reasons for making the acquisition, the curators are clearly aware that they harbor some potentially explosive material in their storage rooms. And they did not make it easy for me to gain access.

On my first visit, I was informed by a good-natured but wary supervisor that the restrictive grant of Sheldon’s materials by his estate would permit me to review only the written materials in the Sheldon archives. The actual photographs, he said, were off-limits. To see them, I would have to petition the chief of archivists. Determined to pursue the matter to the bitter end, I began the process of applying for permission.

In their online guide to collections I found the entry for SHELDON, WILLIAM HERBERT (1898-1977), Papers. It notes that the collection is 150 linear feet. It also includes a line that reads “RESTRICTION: The photographic material is not available for research.”

While Rosenbaum’s hunt was for the photographs, some of his most interesting discoveries came from the papers themselves. During his three month wait for permission to view the photos, he reviewed boxes of letters and notes. See Rosenbaum’s article for details – but it was Sheldon’s own words in those papers that revealed he held racist views and that he seemed more concerned with his research than with the psychological impact of his research on the girls whose photos he arranged to take.

When finally Rosenbaum was given the opportunity to review some 20,000 negatives of the photos (no photos and no names) we read:

A curator trundled in a library cart from the storage facility. Teetering on top of the cart were stacks of big, gray cardboard boxes. The curator handed me a pair of the white cotton gloves that researchers must use to handle archival material.

I love it – gray cardboard boxes and white cotton gloves. He even mentions the finding aids and gives examples of how the groups of photos are described. I also appreciate the earlier acknowledgment of the “solid archival reasons for making the acquisition”.

Rosenbaum looked through a lot of the negatives, mostly to verify that what the finding aids claimed were present were in fact in those gray boxes. He was struck by the contrast between the expressions on the mens’ and womens’ faces.

For the most part, the men looked diffident, oblivious. That’s not surprising considering that men of that era were accustomed to undressing for draft physicals and athletic-squad weigh-ins. But the faces of the women were another story. I was surprised at how many looked deeply unhappy, as if pained at being subjected to this procedure. On the faces of quite a few I saw what looked like grimaces, reflecting pronounced discomfort, perhaps even anger. I was not much more comfortable myself sitting there in the midst of stacks of boxes of such images. There I was at the end of my quest. I’d tracked down the fabled photographs, but the lessons of the posture-photo ritual were elusive.

He found the missing photos – but no easy answers. This is a great combination of a compelling story and a realistic representation of archives and archivists. The records don’t always hold the answers to the question you thought you were asking – but sometimes they hold secrets you hadn’t expected.

So many elements tie back to the choices made by individual archivists – sometimes made in the heat of the moment or under great community pressure. I think this story is a particularly poignant example of the downstream effects of these sorts of hard choices. It isn’t often that we can see cause and effect this clearly.

What would you have done? Would you have burned the photos or stored them away? Would you have stepped forward to take Sheldon’s records? If something like this happened today – what do you think the future of these photos might be?

Book Review: Dreaming in Code (a book about why software is hard)

Dreaming in Code: Two Dozen Programmers, Three Years, 4,732 Bugs, and One Quest for Transcendent Software
(or “A book about why software is hard”) by Scott Rosenberg

Before I dive into my review of this book – I have to come clean. I must admit that I have lived and breathed the world of software development for years. I have, in fact, dreamt in code. That is NOT to say that I was programming in my dream, rather that the logic of the dream itself was rooted in the logic of the programming language I was learning at the time (they didn’t call it Oracle Bootcamp for nothing).

With that out of the way I can say that I loved this book. This book was so good that I somehow managed to read it cover to cover while taking two graduate school courses and working full time. Looking back, I am not sure when I managed to fit in all 416 pages of it (ok, there are some appendices and such at the end that I merely skimmed).

Rosenberg reports on the creation of an open source software tool named Chandler. He got permission to report on the project much as an embedded journalist does for a military unit. He went to meetings. He interviewed team members. He documented the ups and downs and real-world challenges of building a complex software tool based on a vision.

If you have even a shred of interest in the software systems that are generating records that archivists will need to preserve in the future – read this book. It is well written – and it might just scare you. If there is that much chaos in the creation of these software systems (and such frequent failure in the process), what does that mean for the archivist charged with the preservation of the data locked up inside these systems?

I have written about some of this before (see Understanding Born Digital Records: Journalists and Archivists with Parallel Challenges), but it stands repeating: If you think preserving records originating from standardized packages of off-the-shelf software is hard, then please consider that really understanding the meaning of all the data (and business rules surrounding its creation) in custom built software systems is harder still by a factor of 10 (or a 100).

It is interesting for me to feel so pessimistic about finding (or rebuilding) appropriate contextual information for electronic records. I am usually such an optimist. I suspect it is a case of knowing too much for my own good. I also think that so many attempts at preservation of archival electronic records are in their earliest stages – perhaps in that phase in which you think you have all the pieces of the puzzle. I am sure there are others who have gotten further down the path only to discover that their map to the data does not bear any resemblance to the actual records they find themselves in charge of describing and arranging. I know that in some cases everything is fine. The records being accessioned are well documented and thoroughly understood.

My fear is that in many cases we won’t know that we don’t have all the pieces we need to decipher the data until many years down the road leads me to an even darker place. While I may sound alarmist, I don’t think I am overstating the situation. This comes from my first hand experience in working with large custom built databases. Often (back in my life as a software consultant) I would be assigned to fix or add on to a program I had not written myself. This often feels like trying to crawl into someone else’s brain.

Imagine being told you must finish a 20 page paper tonight – but you don’t get to start from scratch and you have no access to the original author. You are provided a theoretically almost complete 18 page paper and piles of books with scraps of paper stuck in them. The citations are only partly done. The original assignment leaves room for original ideas – so you must discern the topic chosen by the original author by reading the paper itself. You decide that writing from scratch is foolish – but are then faced with figuring out what the person who originally was writing this was trying to say. You find 1/2 finished sentences here and there. It seems clear they meant to add entire paragraphs in some sections. The final thorn in your side is being forced to write in a voice that matches that of the original author – one that is likely odd sounding and awkward for you. About halfway through the evening you start wishing you had started from scratch – but now it is too late to start over, you just have to get it done.

So back to the archivist tasked with ensuring that future generations can make use of the electronic records in their care. The challenges are great. This sort of thing is hard even when you have the people who wrote the code sitting next to you available to answer questions and a working program with which to experiment. It just makes my head hurt to imagine piecing together the meaning of data in custom built databases long after the working software and programmers are well beyond reach.

Does this sound interesting or scary or relevant to your world? Dreaming in Code is really a great read. The people are interesting. The issues are interesting. The author does a good job of explaining the inner workings of the software world by following one real world example and grounding it in the landscape of the history of software creation. And he manages to include great analogies to explain things to those looking in curiously from outside of the software world. I hope you enjoy it as much as I did.