The Cathedral and the Bazaar: Two Visions for Archiving the Now

We often speak of web archiving as a monolithic endeavor, a grand project of memory. But in the shadows of major institutional archives, a different kind of preservation thrives. The contrast isn't just about scale, but about philosophy. It's the difference between building a cathedral and tending a bazaar—and both are essential for capturing the fluid, living web.

The Structured Snapshot

The cathedral approach is one of deliberate, structured capture. Think of a national library's web archive: vast, systematic crawls scheduled at regular intervals. The goal is comprehensiveness and authenticity, aiming to create a definitive, verifiable record of a domain or an event. The process is meticulous, often involving complex selection policies, legal deposit frameworks, and robust technical infrastructure to store and replay petabytes of data. The resulting archive is a fortress of information, a monumental effort to freeze a slice of the digital universe with as much fidelity as possible. Its strength is its authority and its commitment to the long-term, governed by professional standards and intended to serve researchers a century from now.

But what of the web that pulses between these official snapshots? The news article updated five minutes after the crawl, the social media thread that explodes and vanishes in an afternoon, the ephemeral live stream of a protest or a celebration? This is where the cathedral's walls cannot reach.

The Chaotic Stream

Enter the bazaar. This is the archiving of the now, practiced by individuals and communities using tools like browser extensions, custom scripts, and decentralized platforms. It’s less about creating a perfect, replayable snapshot and more about capturing a stream of evidence, context, and conversation. An activist might screencast a webpage they fear will be altered. A developer might continuously pipe their social media feed into a personal archive. A community might collaboratively document a breaking event using simple tools, gathering fragments—URLs, quotes, screenshots, videos—into a shared timeline.

This archive is messy, subjective, and alive. It prioritizes immediacy and perspective over pristine replay. Its authenticity is derived not from institutional verification, but from provenance and witness—the metadata of who captured it, when, and why. It’s the difference between an official photograph of a street and a dozen blurry, overlapping videos from bystanders' phones. The latter may lack polish, but it contains a polyphonic truth the former cannot.

The cathedral builds for eternity; the bazaar operates in real-time. One seeks to be the final, authoritative copy; the other is a living collection of working copies, each with its own viewpoint. Neither can do the other's job. We need the cathedral’s enduring, structured vaults to ensure our digital civilization isn't lost. But we desperately need the vibrant, chaotic bazaar to remember how it actually felt to live through its fleeting moments. The complete archive of our time will be found not in one model or the other, but in the uneasy, essential dialogue between them.

Notes & further reading

A few pages I came back to while writing this: