Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

P5 Parsing: Office of Special Education and Rehabilitative Services #22

Closed
6 tasks done
nightsh opened this issue Mar 2, 2020 · 0 comments
Closed
6 tasks done
Assignees

Comments

@nightsh
Copy link
Collaborator

nightsh commented Mar 2, 2020

ref. #7

Create a HTML parser that integrates into the OSERS scraper and replaces the existing dummy parser script.

Tasks:

  • identify the possible page structures in the target site
  • write one or multiple parsers that cover as many cases as possible
  • test if it runs well within the pipeline

Acceptance criteria:

  • we have a parser specific to this site that replaces the initial dummy parser
  • parser creates Dataset instances, each having at least one Resource
  • calls dataset.dump() method and dumps serialized output in a directory specific to this scraper

TBD: List of potentially different structures and one or two false positives to test the scraper against.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants