The Myth of Total Capture: Why Archiving Everything Is a Preservation Failure
In the world of digital preservation, there exists a powerful, seductive, and ultimately dangerous fantasy: the dream of total capture. It’s the notion that with enough storage, enough crawlers, and enough processing power, we can archive everything. Every webpage, every tweet, every fleeting digital moment. This is often presented as the ultimate goal, the pinnacle of archival practice. But what if this drive to hoard it all is not a triumph, but a profound failure of our archival duty?
The failure is not one of technology, but of philosophy. An archive that strives to contain everything ultimately values nothing. It becomes a digital landfill, a vast and undifferentiated heap where the significant is buried alongside the trivial. True preservation is not about amassing volume; it is an act of rigorous, thoughtful curation. It requires humans to make difficult decisions about what is worthy of saving for future understanding. It is the argument, the thesis, the story we choose to tell about our present to the future. A ‘save everything’ approach is an abdication of that responsibility. It is the equivalent of a historian being given access to a vast, unsorted warehouse of artifacts and simply locking the door instead of building an exhibit.
This obsession with totality also creates a false sense of security. We point to the petabytes stored in massive data centers and whisper, "It’s all in there." But this is an illusion. An archive without curation is un-navigable. A researcher of the future, faced with a zettabyte of uncategorized, context-less data, is arguably worse off than one with a carefully selected, well-described collection of a few terabytes. The sheer scale becomes a barrier to meaning. The signal is lost in the noise, and the noise is exponentially growing.
Furthermore, the myth of total capture is ahistorical. It ignores the fundamental truth that loss is an intrinsic part of history. The gaps, the silences, the things that did not survive—these are themselves powerful historical data points. They tell us about fragility, about power structures, about what a society deemed unimportant or threatening. A perfectly complete record would be an alien and unnatural thing, stripping history of its texture and its mysteries. Our drive to eliminate all loss is, in a way, an attempt to sanitize the past and control the narrative with an impossible totality.
This is not an argument for carelessness. It is a plea for intentionality. The most critical work in digital preservation happens long before the web crawler is deployed. It happens in the meetings where we ask: "What story are we trying to preserve? What voices are we elevating? What context is necessary for this to make sense in fifty years?" We must be gardeners, not quarry miners. We must prune, nurture, and shape the digital record. We must accept that we cannot save everything, and that in this acceptance lies our greatest power: the power to choose, to value, and to meaningfully preserve.
Notes & further reading
A few pages I came back to while writing this: