The Ghost in the Ledger: On the Politics of What Gets Archived
There’s a comforting, almost default assumption that guides much of the public conversation around web archiving and open data: that more is better. The prevailing wisdom suggests that if we can just save everything—every tweet, every government dataset, every fleeting webpage—we are performing a neutral, virtuous act for future historians. We are creating a complete record. But this is a seductive and dangerous myth. The real story of any archive is not found in its vast holdings, but in its profound and purposeful silences.
Archiving is not, and has never been, a passive act of collection. It is an active, deeply political process of selection. Every decision to capture a URL, to scrape a database, or to preserve a file format is simultaneously a decision to ignore another. These choices are made by humans and algorithms guided by human priorities, and they are steeped in the biases of their time, their funding sources, and their technical capabilities. The archive, therefore, is not a mirror reflecting reality; it is a curated gallery, and the curators are often invisible.
Consider the typical web crawl. It prioritizes the popular, the well-linked, the stable. The front pages of major news outlets are captured with feverish regularity. But what of the fragile, ephemeral web? The local community forum that shuts down without fanfare? The artist’s portfolio hosted on a now-defunct free service? The dissident blog that is deliberately obscured? These spaces, often the most vital and vulnerable, slip through the crawler’ nets. They become the ghosts in the machine, the negative space that defines the positive.
This political selection extends to open data portals as well. A government may release vast troves of easily parsable economic data, a win for transparency. But what datasets are being withheld under claims of national security or administrative burden? Which ones are released in proprietary or difficult-to-use formats, creating a transparency barrier for all but the most technically adept? The ledger shows us what we are permitted to see, and in doing so, it silently instructs us on what questions we are permitted to ask.
The true critique, then, is of the idea of the neutral archive. By pretending our preservation efforts are objective, we blind ourselves to their inherent subjectivity. We risk creating a future historical record that is not comprehensive, but one that is systematically skewed toward power, popularity, and technical convenience. To build a better archive, we must first acknowledge the ghost in the ledger. We must actively seek out the gaps, champion the preservation of the marginalized and fragile, and question not just what is saved, but why everything else was left to fade away. The most important record we preserve might be an honest accounting of our own curatorial biases.
Notes & further reading
A few pages I came back to while writing this: