Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.Sign up
Update FDA collector to work with the new Drugs@FDA website #705
They changed the layout of the website (http://www.accessdata.fda.gov/scripts/cder/daf/), which ended up breaking our scraper. Thankfully, the changes were not too drastic, so this should be relatively easy for someone with some experience with scrapers. Our current FDA collector has some tests and comments that can help as well.
If you're interested in taking this task, this is the best starting point: https://github.com/opentrials/collectors/blob/master/collectors/fda_dap/spider.py