The Ghost in the Spreadsheet: On the Unseen Hand of the Curator
We speak of open data as if it were a raw material, a pristine resource mined from the digital earth and presented for our unbiased analysis. A dataset appears, and we accept its contents as a given, a truth. We focus on the numbers, the columns, the potential insights. But we rarely stop to consider the most important, and most human, element of all: the curator.
Every public record, every digitized archive, every released dataset has passed through human hands. Decisions were made. A choice to include this field and exclude that one. A judgment call on how to categorize an ambiguous entry. A selection of which years to publish, which departments to represent, which format would be most "usable." This is not a corrupting influence; it is an inevitable and deeply human process. The data is never just data. It is a narrative, shaped by silent, unseen authors.
This curation is a form of translation. It takes the complex, often messy reality of an institution's internal workings and translates it into the clean, structured language of rows and columns. In that translation, things are inevitably lost. The context of a hurried memo, the tone of a meeting, the reason a project was shelved—these human textures are smoothed into categorical values. The dataset becomes a map of a territory, but the map is not the territory itself. It is an interpretation.
To use public data responsibly, then, is to read it not just for its explicit content, but for the ghost of its creation. It is to look for the seams, the gaps, the curious absences. Why does this record begin in 1995 and not 1985? What might have happened before the consistent logging began? Why are these particular categories used, and what alternative categorizations were possible? These are not technical questions; they are deeply philosophical ones. They ask us to engage with the data not as a perfect artifact, but as a human document, replete with all the limitations and intentions of its creators.
In our quest for objective truth through open information, we must first acknowledge the inherent subjectivity of its assembly. The curator’s hand is always there, guiding, shaping, deciding. To see that hand is not to discredit the data, but to understand it more fully. It is to move from being a mere consumer of information to becoming a thoughtful reader of the quiet, structural stories told between the lines. The most valuable data point is often the one that was never recorded, and the most important field is the one asking us who decided to leave it out.
Notes & further reading
A few pages I came back to while writing this: