GitHub - yeohbraddy/web-crawler: Distributed web crawler that starts from a given URL finds all children URLs ignoring external domains like Facebook, or *.givenURL.*, and crawls to a certain depth

To run:

mvn clean install && mvn exec:java

Name		Name	Last commit message	Last commit date
Latest commit History 5 Commits
src		src
.gitignore		.gitignore
README.md		README.md
pom.xml		pom.xml