The Imperfect Keeper: Why Archivists Sometimes Break Their Own Rules

If you’ve ever looked into the world of digital preservation, you’ve likely encountered the rules. They are the solemn commandments etched into the digital stone by institutions like the Library of Congress or the Internet Archive: create regular, verified backups; use open, non-proprietary file formats; maintain detailed, standardized metadata. These are the pillars of proper archival practice, the bedrock upon which we build our digital memory. They are, without question, the right way to do things. So why do the very people who preach these principles sometimes end up breaking them?

The answer lies in the messy, urgent reality of the salvage operation. Imagine an archivist, let’s call her Anya, who gets a tip. A small, beloved independent music forum, a community that has existed since the early 2000s, is about to have its hosting expire. The sole administrator, who has been paying the bills for two decades, can no longer afford to do so. The plug will be pulled in 48 hours. Anya has her scripts, her tools, her perfect workflow for a methodical, by-the-book crawl. But that workflow requires time—time to negotiate permissions, time to configure the crawler to respect robots.txt, time to structure the data perfectly.

Faced with a ticking clock, Anya does not follow the rules. She uses a blunt, aggressive scraping tool that ignores the site’s politeness settings, because pausing between requests might mean the server goes dark before the final pages are saved. She dumps the raw, chaotic HTML, images, and broken links into a massive, poorly-organized ZIP file. The metadata is an afterthought; a single text file with the date and the forum’s URL. It’s a ugly, inelegant capture, a digital crime scene photo rather than a curated museum piece. By the book, it’s a failure. In reality, it’s a rescue.

This is the archivist’s dilemma. The perfect is often the enemy of the preserved. The rules of preservation are designed for a controlled, ideal environment. But the digital world is not controlled or ideal. It is governed by entropy, bankruptcy, shifting corporate policies, and simple neglect. The most significant cultural artifacts are often the most ephemeral, held together by digital duct tape and the goodwill of a single individual.

In these moments, archivists make a calculated choice. They prioritize existence over perfection. A flawed, messy, incomplete capture is infinitely more valuable than a perfect capture that never happened. It becomes a seed of data that can, perhaps years later, be cleaned, structured, and properly catalogued. The broken rules create a debt—a technical one that future archivists must repay. But it is a debt incurred to save something from oblivion.

This doesn’t invalidate the rules; it contextualizes them. They are the goal, the standard to which we aspire when time and circumstance allow. But they are also a luxury. The work of preservation is not just about building pristine digital libraries. It is also about the frantic, unglamorous work of pulling things from the fire, even if our hands get burned and the artifact comes out a little charred. Sometimes, the most important rule is the one you break to ensure there’s something left to preserve at all.

Notes & further reading

A few pages I came back to while writing this: