Government data often underpins policy debates. Nevertheless, those who work with it will know how uniquely frustrating it can be. Relative to the private sector, government systems collect data in idiosyncratic ways. They prioritize continuity and legality over ease-of-use, in anticipation of a narrow set of users. As a result, these datasets can feel impenetrable.
In October 2024, I was trying t...
The article presents a compelling case for the challenges of working with government data, emphasizing its administrative origins and the resulting limitations for policy analysis. The strongest version of this narrative acknowledges the systemic barriers—outdated systems, inconsistent record-keeping, and declining survey reliability—that make government data difficult to use. It also highlights the value of interdisciplinary collaboration and practitioner knowledge in unlocking insights from th...