Archives For Uncategorized

We’ve spent a lot of time in Oregon. Well, not in Oregon, physically, but searching for, obtaining and parsing election results from the state. County-level data is easy to find: the Secretary of State’s office provides electronic PDFs of results for elections dating back to 2004. Thanks to Tabula, those were easy to convert so that we could load them into our database.

But precinct-level data was, as we’ve said before, a whole other story. We’ve written about specific aspects of this process, but here is the complete story about how we published what is, to the best of our knowledge, the first freely-available set of statewide precinct-level election results for 2012 and 2014 elections in Oregon.

We began gathering Oregon data in early May 2015, starting with the county-level data and then moving onto individual counties. We asked about other sources of precinct-level data, but never found a freely available one. The state does not maintain precinct-level results data. When we turned to the counties, we found a few that provided machine-readable results (mostly in PDF format), including the largest counties (Multnomah, Clackamas and Marion among them). Parsing those results was by no means simple, but the files were consistent enough to allow us to grab precinct results.

But for the bulk of Oregon’s 36 counties, here was our process:

Email county clerk’s office asking about the availability of results. Sometimes we called.

Request results for 2000-2014, if available. If not, request as much as they had.

For some, pay a fee for the results, ranging from $37.50 (Union County) to $222.75 (Tillamook County, just for 2010-2014).

Get the results, typically PDF image files that would require OCR to convert into machine-readable data. In some cases, we were sent paper via the postal service.

Create election and county-specific files.

We had several volunteers (some listed here) help us with the conversion process, which helped us get the data converted faster. All told, we spent more than $1,000 on Oregon precinct-level results, and for that we got a wide range of files covering most of the elections we sought but not all.

We built a matrix showing the county coverage that we have, something that we’ll be doing for other states and putting on openelections.net as well. In many counties, getting pre-2008 results was either impossible or cost-prohibitive. In one case, Crook County, the precinct results from the 2010 general and 2012 primary elections are no longer available. To repeat: no government entity has precinct-level results for Crook County for those two elections. They are missing from the public record.

Almost every county clerk we spoke or emailed with was friendly and wanted to help us. Many offered results for free online, and we happily downloaded those files. Others had results but have not posted them. Many of them appear to use the same software to produce election results reports but continue to print out those electronic reports and scan them, reducing legibility.

Oregon is, sadly, not an isolated case. There are other states where obtaining precinct-level results is a painstaking effort, even when counties and states produce electronic version of political maps and voter files. Election results, in too many cases, are a weak link in our civic infrastructure.

So we’ll be back in touch with our Oregon clerks at the end of this year or early next year, asking for more election results. We’ll know what to expect this time, and it should be a less-expensive and shorter process. But on both counts, the progress isn’t enough.

The OpenElections team is very pleased to welcome Geoff Hing as our newest staff member. In his role as OpenElections Developer, Geoff will be working closely with Derek and Serdar on the core architecture of the project, as well as overseeing and assisting volunteer coders as they help wrangle election data from across the country.

Geoff is a technologist and cultural worker who lives in Chicago. He works developing technologies that intersect with community information needs, civic data and participatory governance. His work reflects connections with engineering, journalism and do-it-yourself culture. He joins us from recent work for Floodlight Project and The Work Department. In the past he has done data-driven technology projects with Food Genius and Metro Chicago Information Center. @geoffhing

We had a great turnout last Saturday for our second Metadata Sprint. Joining the OpenElections team based in LA, San Francisco and DC were journalists and developers from Austin, Boulder, Chicago, DC, and Madison.

Between 8 of us, we entered 120 elections into our system, significantly closing the gap on our metadata gathering progress. In fact we now have onlyfour states left to be adopted – LA, MS, SD, and UT. More on joining in here.