P2 Parsing: Office of Career, Technical and Adult Education

[nightsh]

ref. #4

Create a HTML parser that integrates into the OCTAE scraper and replaces the existing dummy parser script.

https://www2.ed.gov/about/offices/list/ovae/index.html

Tasks:

• identify the possible page structures in the target site
• write one or multiple parsers that cover as many cases as possible
• test if it runs well within the pipeline

Acceptance criteria:

• we have a parser specific to this site that replaces the initial dummy parser
• parser creates Dataset instances, each having at least one Resource
• uses scrapy pipelines to dump datasets

TBD: List of potentially different structures and one or two false positives to test the scraper against.

[osahon-okungbowa]

All done with these tasks. Please review and close as necessary