Skip to content
This repository was archived by the owner on Nov 30, 2019. It is now read-only.

Caellian/Crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Crawler

Tiny python program that crawls results for input search from DuckDuckGo, Bing and Yahoo and then finds input regex in result websites. This could only ever be used for something good... ;)

Dependencies

  • beautifulsoup4
  • selenium

To install all requirements using pip, execute:

pip install -r requirements.txt

PhantomJS is also required, but provided within this distibution. If you have any trouble, delete PhantomJS files and install it manually.

License

Licensed under MIT License.

About

Python regex website crawler.

Resources

License

Unknown, BSD-3-Clause licenses found

Licenses found

Unknown
LICENSE.md
BSD-3-Clause
phantomjs-license.BSD

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages