Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add news scraper for Contra Costa county #63

Closed
Mr0grog opened this issue May 27, 2020 · 0 comments · Fixed by #71
Closed

Add news scraper for Contra Costa county #63

Mr0grog opened this issue May 27, 2020 · 0 comments · Fixed by #71
Labels
enhancement New feature or request news Related to scraping news (rather than data)

Comments

@Mr0grog
Copy link
Collaborator

Mr0grog commented May 27, 2020

News scrapers live in the news directory. You can follow the San Francisco scraper as an example.

Contra Costa County

  1. Has a “news flash” RSS feed with some coronavirus-related items. We could filter it by key terms.

  2. Has a coronavirus-specific “news flash” page (no corresponding RSS). Each items is a paragraph, often with a link or two. It’s not entirely clear how to parse this into a list of news links in a reliable way.

  3. The Health Services Department has a coronavirus updates page we can scrape (no RSS).

  4. The Health Services Department has a newsroom with news and press releases, but is not coronavirus-specific (no RSS).

I think just using (3) is the best bet here.

@Mr0grog Mr0grog added enhancement New feature or request news Related to scraping news (rather than data) labels May 27, 2020
Mr0grog added a commit that referenced this issue May 30, 2020
Mr0grog added a commit that referenced this issue Jun 1, 2020
Mr0grog added a commit that referenced this issue Jun 2, 2020
Mr0grog added a commit that referenced this issue Jun 4, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request news Related to scraping news (rather than data)
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant