Skip to content

popart/basicCrawl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

python 2.7

-------------------------------------
pip install -r requirements.txt

-------------------------------------
-- general db info
db { host: '...',
     user: '...',
     password: '...',
     database: '...' }

-- connect (enter password "andrew")
mysql -u $USER -p -h $HOST $DB

-- scratch & replace table
drop table if exists link_edges;
create table link_edges (
  url_from TEXT,
  url_to TEXT
);


About

Crawl links from a website, storing them in a database

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages