The Unwritten Archive: What Gets Lost When We Only Save the Published Web
We tend to think of web archiving as a process of capturing pages, of freezing in time the text and images a website presented to the world. Projects like the Internet Archive’s Wayback Machine are monumental libraries of this published web. But if you’ve ever been part of an online community, or collaborated on a document, or even just left a thoughtful comment on a news article, you know that a vast portion of our digital lives exists in the spaces between the published pages. This is the unwritten web, and it is vanishing at an alarming rate.
Consider the comment section beneath a pivotal news article. The article itself will be archived, but the public conversation that unfolded below it—the corrections, the shared experiences, the heated debates—often disappears when the site’s platform changes or the article’s URL structure is altered. These comments are not just chatter; they are a primary source document capturing the public’s immediate, visceral reaction to an event. They are the margin notes in the history book of our present.
Or think of a collaborative document, like a shared spreadsheet or a wiki page for a local community group. The final version might get saved somewhere, but the history of its creation—the suggestions, the rejected ideas, the debate over a single cell’s value—is usually lost. This process reveals how decisions were made, how consensus was built, and how understanding evolved. It is the digital equivalent of a scholar’s drafts and notes, and it is often just as valuable as the final published work.
The Process is the Artifact
This presents a profound challenge for digital preservationists. We have become adept at saving the product, but we are failing to save the process. The tools that facilitate this collaboration—Google Docs, Slack channels, comment APIs—are often walled gardens or proprietary systems not designed for external archiving. Their very nature is ephemeral, focused on the now.
This loss matters because it flattens our historical record. Future researchers looking back at our era will see the polished, public-facing content, but they will have a much harder time understanding how it came to be. They will see the speech, but not the gasps from the crowd. They will see the legislation, but not the grassroots email campaign that helped shape it. They will see the scientific paper, but not the months of messy, back-and-forth discussion between colleagues that refined the hypothesis.
Archiving the unwritten web requires a new mindset. It means valuing process as much as product. It means developing tools and standards to capture these dynamic, interactive, and often authenticated streams of data. It means convincing platform owners of the cultural value locked within their transient data. The published web is the tip of the iceberg. If we are to truly preserve our digital culture, we must find a way to dive deeper and save the rest of it, before it sinks into silence.
Notes & further reading
A few pages I came back to while writing this: