Skip to content

sreenigsd/arachnid

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 

Repository files navigation

arachnid

Arachnid is a scalable crawler framework. It covers the whole lifecycle of a crawler: downloading, url management, content extraction and persistent. It can simplify the development of a specific crawler.

About

Arachnid is a scalable crawler framework. It covers the whole lifecycle of a crawler: downloading, url management, content extraction and persistent. It can simplify the development of a specific crawler.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors