A Web Crawler based on Java. Strictly Java.
Switch branches/tags
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
build
nbproject
src
.gitattributes
.gitignore
README.md
build.xml
manifest.mf

README.md

Wrawler

A Java-Based Web Crawler for the Modern Web.

This project leans purely towards Java and will thus not include any third-party libraries like JSoup.

Should you want to develop this project further with third-party libraries, let me know as I'll be more than happy to open up a branch specially for that.

Pre-requisites

  1. A Java IDE
  2. Java Development Kit 8
  3. Some RegEx Knowledge if you want to include more Search Engines