Skip to content

Source code for PyConIT talk: "From website to JSON data in 30 minutes with Scrapy!"

License

Notifications You must be signed in to change notification settings

palazzem/google-blacklist-me

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Google blacklist me

(aka "Scrape some emails around using Google search")

DISCLAIMER: this is a code example for Scrapy. DON'T USE IT for bad purpose or for your production environment.

This code is used during PyConIT talk: "From website to JSON data in 30 minutes with Scrapy".

How to use it

$ pip install -r requirements.txt

Create urls.txt file and put Google search keyword for each lines like

PyCon
Evonove
Wow

Launch your scraper with

$ scrapy crawl bot -a filename=urls.txt -o emails.json -t json

Happy email crawling!

About

Source code for PyConIT talk: "From website to JSON data in 30 minutes with Scrapy!"

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published