Branch: master
Find file Copy path
Fetching contributors…
Cannot retrieve contributors at this time
90 lines (70 sloc) 3.09 KB


Your preferred open source focused crawler for the Deep Web.

Maven Central Build Status Coverage Status Javadocs


Our aim is to create a blazing fast, fully customizable and robust crawler that is simple and handy to use.

Quick links

Website | API Reference | Examples | Tutorial | PreferredAI


  • Multi-threaded out of the box
  • Structured crawling with JSoup integration
  • Page Validation
  • Automatic Retries
  • Proxy support

Getting started

Getting started with Venom is quick and easy. There are two ways to get started.

Clone our examples or tutorial

If you are starting out in a new project, you can consider cloning our Examples:

git clone

or, if you would like a more guided package, you can check out our Tutorial:

git clone

Add a dependency

If you already have a project then just add Venom as a dependency to your pom.xml:

    <!-- Venom: A focused crawler framework @ -->


If you are new to Venom, we have created a set of exercises to get you up and sprinting. The exercises are bundled in our venom-tutorial. More information can be found on this page.


Think you are beyond exercises? Get started quickly with these few lines of code.

public class Example {
    private static class VenomHandler implements Handler {
        public void handle(Request request,
                           VResponse response,
                           Scheduler scheduler,
                           Session session,
                           Worker worker) {
            String about = response.getJsoup().select(".about p").text();
            System.out.println("ABOUT: " + about);
    public static void main(String[] args) throws Exception {
        try (Crawler c = Crawler.buildDefault().start()) {
            Request r = new VRequest("");
            c.getScheduler().add(r, new VenomHandler());


Apache License 2.0