Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
.gitignore		.gitignore
README.md		README.md
domain.py		domain.py
general.py		general.py
link_finder.py		link_finder.py
main.py		main.py
spider.py		spider.py

Repository files navigation

Crawler

An intelligent web crawler

This crawler gathers only links from the website it crawls.

Enjoy

About

An intelligent web crawler

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%