Uses Scrapy to crawl bloomberg.com recursively for article text. The data is stored realtime to your local mongodb instance(currently configured to localhost, db:data, collection:items). Cd into the directory and do "scrapy crawl bloomberg_spider" to run the crawler.
-
Notifications
You must be signed in to change notification settings - Fork 0
har777/bloomberg_scraping
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Scraping bloomberg.com to extract article text and save it to a mongodb collection.
Resources
Stars
Watchers
Forks
Releases
No releases published