forked from rmax/dirbot-mysql
-
Notifications
You must be signed in to change notification settings - Fork 0
parsing/scrapy-googledir-mysql
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
1. create database
$ mysql -uroot
mysql> create database googledir;
2. create table
$ mysql -uroot googledir < db/mysql.sql
3. start crawling
$ ./scrapy-ctl.py crawl directory.google.com
DB credentials are hardcoded in `googledir/pipelines.py`
About
scrapy's googledir example with mysql store pipeline using twisted's adbapi
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published