Hunting the Deleted: A Beginner's Guide to Using Change Detection for Web Archiving

Most of us think of web archives as vast, frozen libraries, places where we go to find a specific webpage from a specific time. We want to see a news article as it looked before a correction, or a company’s homepage before a major rebrand. This is the "time machine" model of archiving, and it's incredibly powerful. But it’s a passive one. You have to know what you’re looking for, and you have to know it’s gone.

What about the things that vanish before we notice? The small but crucial edits to a government policy page, the quietly deleted blog post from a public figure, the terms of service that changed overnight? For these, we need a more active, almost predatory approach to preservation. We need to go hunting for the deleted. And the simplest tool for this hunt is a technique called change detection.

The core idea is simple: you tell a service to watch a webpage for you. At regular intervals, it takes a snapshot and compares it to the previous one. If it detects a change—any change at all—it sends you an alert. It’s a digital tripwire. The beauty of this method is that it doesn’t require you to be an archivist or a coder. It turns the monumental task of watching the entire web into a manageable, personal project of watching what matters to you.

An Unseen Battlefield

I started doing this after noticing how often local government meeting minutes would be subtly amended days after they were posted. A dissenting comment would be softened, a budgetary figure would be tweaked. The public record was being quietly revised, and without a before-and-after, it was impossible to prove. I wasn’t trying to build a grand archive for the ages; I just wanted to know when a specific document I cared about was altered.

Setting it up is straightforward. You can use a free service like Visualping, Changedetection.io, or a similar tool. You paste the URL of the page you want to watch. Then, you use your mouse to highlight the specific area of the page you’re concerned about—perhaps the text of a regulation, the text of a news article, or a specific data table. This focus prevents you from getting alerts for irrelevant changes, like a rotated banner ad or a updated sidebar menu. You set the frequency of checks (daily is usually sufficient) and provide your email address. After that, you wait.

When the alert arrives, the service shows you a side-by-side comparison, with the added text highlighted in green and the deleted text struck through in red. It’s a stark, undeniable record of the mutation. This immediate, visual feedback is what makes the technique so powerful. You are not just told something changed; you are shown the precise anatomy of the change.

This isn't just about catching nefarious edits. It’s a tool for understanding the web as a fluid, living document. A writer might watch their own published work to see how an editor has changed it. A researcher can track the evolution of a scientific paper's abstract. You become an active participant in the documentary process, capturing the small tremors that usually slip into the digital void. It’s a small act of vigilance, a way of bearing witness to the ephemeral nature of our primary source of information, one webpage at a time.

Notes & further reading

A few pages I came back to while writing this: