A basic web crawler example
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
data
src/main
.gitignore
LICENSE
README.md
pom.xml

README.md

Venom Examples

Your preferred focused crawler based on Venom. Now in a convenient package to quickly get your projects up to speed!

Bundled in this pack is a few fully functional examples to help get you up and sprinting. If you require a tutorial, you can access a tutorial here. For more information, read the tutorial guide below.

Maven Central Build Status Coverage Status Javadocs

Overview

Check out our main Venom page for more information.

Quick links

Website | API Reference | PreferredAI

Examples

venom-examples includes a set of tutorial designed to quickly get you from 0 to 100.

There are 3 examples located in the package ai.preferred.crawler.single, ai.preferred.crawler.stackoverflow and ai.preferred.crawler.iproperty.

ai.preferred.crawler.single.SingleCrawler.java

A basic crawler to get your current IP.

ai.preferred.crawler.stackoverflow.master.ListingCrawler.java

A crawler to get the job listings for Singapore on StackOverflow and export to a CSV file.

ai.preferred.crawler.iproperty.master.ListingCrawler.java

A crawler to get the properties on iProperty.com.sg.

License

MIT License