Towards a Computational History
[Cross-posted to Cliopatria & Digital History Hacks]
Given that relatively few of our colleagues are familiar with digital history yet--and that those of us who practice some form of it aren't sure what to call it: digital history? history and computing? digital humanities?--it may seem a bit perverse to start talking about computational history. Nevertheless, it's an idea that we need, and the sooner we start talking and thinking about it, the better.
From my perspective, digital history simply refers to the idea that many of our potential sources are now online and available on the internet. It is possible, of course, to expand this definition and tease out many of its implications. (For more on that, see the forthcoming interchange on"The Promise of Digital History" in the September 2008 issue of The Journal of American History). To some extent we're all digital historians already, as it is quickly becoming impossible to imagine doing historical research without making use of e-mail, discussion lists, word processors, search engines, bibliographical databases and electronic publishing. Some day pretty soon, the"digital" in"digital history" is going to sound redundant, and we can drop it and get back to doing what we all love.
Or maybe not. By that time, I think, it will have become apparent that having networked access to an effectively infinite archive of digital sources, and to one another, has completely changed the nature of the game. Here are a few examples of what's in store.
Collective intelligence. Social software allows large numbers of people to interact efficiently and focus on solving problems that may be too difficult for any individual or small group. Does this sound utopian? Present-day examples are easy to find in massive online games, open source software, and even the much-maligned Wikipedia. These efforts all involve unthinkably complex assemblages of people, machines, computational processes and archives of representations. We have no idea what these collective intelligences will be capable of. Is it possible for an ad hoc, international, multi-lingual group of people to engage in a parallel and distributed process of historical research? Is it possible for a group to transcend the historical consciousness of the individuals that make it up? How does the historical reasoning of a collective intelligence differ from the historical reasoning of more familiar kinds of historian?
Machines as colleagues. Most of us are aware that law enforcement and security agencies routinely use biometric software to search through databases of images and video and identify people by facial characteristics, gait, and so on. Nothing precludes the use of similar software with historical archives. But here's the key point. Suppose you have a photograph of known provenance, depicting someone in whom you have an interest. Your biometric software skims through a database of historical images and matches your person to someone in a photo of a crowd at an important event. If the program is 95% sure that the match is valid, are you justified in arguing that your person was in the crowd that day?
Archives with APIs. Take it a step further. Most online archives today are designed to allow human users to find sources and read and cite them in traditional ways. It is straightforward, however, for the creators of these archives to add an application programming interface (API), a way for computer programs to request and make use of archival sources. You could train a machine learner to recognize pictures of people, artifacts or places and turn it loose on every historical photo archive with an API. Trained learners can be shared amongst groups of colleagues, or subject as populations to a process of artificial selection. At present, APIs are most familiar in the form of mashups, websites that integrate data from different sources on-the-fly. The race is on now to provide APIs for some of the world's most important online archival collections.
Models. Agent-based and other approaches from complex adaptive systems research are beginning to infiltrate the edges of the discipline, particularly amongst researchers more inclined toward the social sciences. Serious games appeal to a generation of researchers that grew up with not-so-serious ones. People who might once have found quantitative history appealing are now building geographic information systems. In every case, computational processes become tools to think with. I was recently at the Metropolis on Trial conference, loosely organized around the 120 million word online archive of the Old Bailey proceedings. At the conference, historians talked and argued about sources and interpretations, of course, but also about optical character recognition and statistical tables and graphs and search results generated with tools on the website. We're not yet at a point where these discussions involve much nuanced analysis of layers of computational mediation... but it is definitely beginning.
Tags: computational history | digital history
William J Turkel - 7/25/2008
Genealogists will be among the most enthusiastic users of a newfound ability to trace individual lives through a succession of archives, which is one of the things that archival APIs will really facilitate.
William Harshaw - 7/25/2008
IMO historians should also encourage outfits like the Government Printing Office and OMB to move government documents to formats accessible by search engines.
There's also going to be a convergence between genealogists and historians as the genealogy community gets historical data such as censuses indexed and on line.
William J Turkel - 7/22/2008
Hey Sterling! Text mining is a great example, too. I just finished a marathon series of fourteen text mining posts on <em>Digital History Hacks</em> and I think I was subconsciously taking a break from the subject. The interesting thing about the biometric example is that the way that it accomplishes its particular form of magic is not really human readable. (Unlike a number of text mining techniques, which are more open to human inspection.) So even if we understand at some level how the algorithm works, its internal representation doesn't map nicely on to any of our analytic categories. Then we're in a position of asking ourselves how confident we have to be in the technology before we can base an argument on the results. If / when evidence is good enough for a court of law, should it be good enough for the historical community?
Sterling Fluharty - 7/21/2008
You mention biometric software for images and video. Why did you leave out text mining?
- New Hampshire professors at odds with library over discarded books
- Troubled history fuels Japan-China tension
- Independent Scotland's last gasp forgotten in Panama jungle
- LBJ was the ‘most-threatened president in American history’
- New exhibit at the World War I Museum ... Over by Christmas: August-December 1914
- Ken Burns on Colbert to promote his new documentary, "The Address"
- UC Santa Barbara History Department featuring a series on the Great Society at 50
- Historians are trying to recover censored texts from World War I poets
- Diane Ravitch blasts the NYT for failing to understand the controversy over Common Core
- Mormon history professors debate atheists in bid to foster greater understanding