Skip to content

tpeng/googlesearch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 

Repository files navigation

Googlesearch

Scrape the google advanced search result with scrapy bootstraped from given queries. This spider can be used to collect the HTML pages to prepare for a corpus.

Usage

scrapy crawl googlesearch -a queries='xxx' -a region='xxx' replace the 'xxx' to the keywords you want search with Google and the region (e.g. ie for Ireland) you wish to limit to.

About

Scrape the Google search result with Scrapy.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages