Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Washington datasource #145

Closed
ghing opened this issue May 27, 2014 · 10 comments
Closed

Washington datasource #145

ghing opened this issue May 27, 2014 · 10 comments
Assignees
@ghing
Labels
WA

Comments

@ghing
Copy link
Contributor

ghing commented May 27, 2014

After preprocessing the data (#144), wire it into a datasource.
@ghing ghing self-assigned this May 27, 2014
@ghing ghing added in progress and removed blocked labels May 27, 2014
@ghing
Copy link
Contributor Author

ghing commented May 30, 2014

I found some issues with dates in the database dump and metadata entries. They are:

  • Wrong date in database dump for 2000 general election. Dump says 2000-11-04. Should be 2000-11-07
  • Missing dashboard entry for 2000-02-29 (presidential) primary
  • Wrong date in database dump for 2000 September primary. Dump says 2000-09-01, should be 2000-09-19
  • Wrong date in database dump for 2001 general election. Dump says 2001-11-01. Should be 2001-11-06
  • Missing dashboard entry for 2001-09-18 September primary
  • Missing dashboard entry for 2003-11-04 general
  • Missing dashboard entry for 2003-09-16 primary
  • Wrong date in database dump for 2004 general election. Dump says 2004-11-09. Should be 2004-11-02
  • Wrong date in database dump for 2004 primary election. Dump says 2004-09-21. Should be 2004-09-14.
  • Missing dashboard entry for 2004-09-14.
  • Missing dashboard entry for 2006-09-19 primary
  • Dashboard entry for a 2006 primary is 2006-11-07. 2006-11-07 is the date of the general election.
  • Dashboard entry for 2006 general election is 2006-11-06. Should be 2006-11-07.

I'm going to follow up with Summer and her WA state contact about this.

@ghing
Copy link
Contributor Author

ghing commented May 30, 2014

I emailed Nick Pharris, Elections Information Specialist of the Elections Division, Office of the Secretary of State to check about the election date discrepancies. I also emailed Suyeon about the metadata questions.

@zstumgoren
Copy link
Contributor

@ghing Can you note this and other communications with data sources in the FOIALogs on the appropriate state pages dashboard admin? It's useful to have this type of history in a single spot. Thanks!

@ghing
Copy link
Contributor Author

ghing commented May 30, 2014

@zstumgoren That makes sense. I tried to do this but got a 500 error! Let me know if you want me to try to find the server logs and figure this out.

@zstumgoren
Copy link
Contributor

@ghing damn. looks like a bug crept in. feel free to poke around the nginx and uwsgi logs if you want to see if there's a quick fix. but let's not get too bogged down in it. can also discuss at scrum.

@zstumgoren
Copy link
Contributor

@ghing fwiw, this only appears to be triggered by the Log inline entries. I've been adding VA election inlines all week without problems. Also just tested and election inlines still work fine.

@ghing
Copy link
Contributor Author

ghing commented May 30, 2014

Is there a way I can add a log not as an inline?

@zstumgoren
Copy link
Contributor

Yep, if we created a free-standing LogAdmin resource and redeployed the
app. Might be easier than debugging. Feel free to go that route if you
like. Would be nice to have :)

On Fri, May 30, 2014 at 1:34 PM, Geoffrey Hing notifications@github.com
wrote:

Is there a way I can add a log not as an inline?

—
Reply to this email directly or view it on GitHub
#145 (comment).

@ghing
Copy link
Contributor Author

ghing commented May 31, 2014

Cleaned up the dashboard metadata entries I referenced above:

  • Added election metadata to dashboard for 2000-02-29 presidential primary
  • Added election metadata to dashboard for 2001-09-18 primary
  • Added election metadata to dashboard for 2003-09-16 primary (only judicial offices afaik)
  • Added election metadata to dashboard for 2003-11-04 general
  • Added election metadata to dashboard for 2004-09-14 primary
  • Added election metadata to dashboard for for 2006-09-19 primary
  • Changed date for 2006 general election from 2006-11-06 to 2006-11-07 in dashboard
  • Removed 2006-11-07 primary entry from dashboard

ghing added a commit that referenced this issue Jun 5, 2014
@ghing
Datasource for Washington
57d87b6 
First pass at implementing the datasource for Washington state.

This requires a url_paths.csv file and a custom fetch class
because some precinct-level results are archived in ZIP files.

The custom fields in url_paths.csv needed to work around the
data quirks are documented in openelex/us/wa/mappings/README.md.

PDF results still need to be converted and there are some cases
where there are multiple precinct-level files and it is unclear
which one to use.

Addresses #145
@ghing ghing mentioned this issue Jun 9, 2014
Closed
ghing added a commit that referenced this issue Jun 9, 2014
@ghing
Add preprocessed URL for Washington .mdb results
6655941 
Add a preprocessed URL for Washington State results that are
shipped in an Access database to the datasource mappings output.

The actual preprocessed result file still needs to be created
(see #150), but the
datasource and fetch task will be ready to consume it once
the preprocessed files are created.

Addresses #145
@ghing
Copy link
Contributor Author

ghing commented Jun 9, 2014

The datasource is done. Follow-up issues opened as #148, #149, #150.

@ghing ghing closed this as completed Jun 9, 2014
@ghing ghing removed the in progress label Jun 9, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ghing ghing

Labels
WA
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@zstumgoren @ghing