public
Description: A creepy crawler
Homepage:
Clone URL: git://github.com/emi/bixo.git
bixo /
name age message
file .gitignore Tue Sep 22 06:30:29 -0700 2009 Fixed problem w/"fresh" builds: .gitingore ign... [Ken Krugler]
file README Mon Oct 26 16:09:20 -0700 2009 Fixed some typos [Ken Krugler]
directory bin/ Mon Oct 26 06:00:52 -0700 2009 First cut at command line tool that can be used... [Ken Krugler]
file build.xml Wed Oct 28 11:33:06 -0700 2009 Make compile the default target, vs. test, so g... [Ken Krugler]
directory contrib/ Wed Oct 28 07:13:24 -0700 2009 Fixed build problem w/helpful project in contrib [Ken Krugler]
directory doc/ Mon Oct 26 16:09:37 -0700 2009 Change msg used during tagging of release. [Ken Krugler]
directory lib/ Mon Sep 21 12:40:47 -0700 2009 Complete the switch to using Maven for jar depe... [Ken Krugler]
file pom.xml Thu Nov 19 21:01:27 -0800 2009 Rolled in Vivek's mods to support language dete... [Ken Krugler]
directory src/ Thu Nov 19 21:02:18 -0800 2009 Add test for valid fetched datum [Ken Krugler]
README
===============================
Introduction
===============================

Bixo is an open source Java web mining toolkit that runs as a series of Cascading
pipes. It is designed to be used as a tool for creating customized web mining apps.
By building a customized Cascading pipe assembly, you can quickly create a workflow
using Bixo that fetches web content, parses, analyzes, and publishes the results.

Bixo borrows heavily from the Apache Nutch project, as well as many other open source
projects at Apache and elsewhere.

Bixo is released under the MIT license.

===============================
Building
===============================

See http://bixo.101tec.com/documentation/building-bixo/ for full details.

You need Apache Ant 1.7 or higher. 

To get a list of valid targets:

% cd <project directory>
% ant -p

To  clean, run the tests and build a jar:

% ant clean test jar

To create Eclipse project files:

% ant eclipse

Than choose "Import existing project" in Eclipse, and select the Bixo project directory.