Skip to content

Version 0.1

Choose a tag to compare

View all tags
@bbengfort bbengfort released this 19 Feb 01:38
· 94 commits to master since this release
v0.1
2562552

This was the initial version of Baleen before the revamp occurred thanks to the PyCon tutorial. Baleen in this form was a command line utility that fetched RSS feeds on demand and stored them in a Mongo database. The input to Baleen is an OPML file that contains an RSS feed listing as well as their topics.

Baleen was originally used to produce a corpus for the District Data Labs NLP with NLTK course. The corpus was then adapted for use in the Statistics.com online course of the same name. The problem is that because Baleen had to be ran manually, it was difficult to get a high quality corpus on demand.

Release: Tuesday, September 23, 2014
Deployed: Thursday, February 18, 2016
Contributor: Benjamin Bengfort

Changes

  • CLI Program to import OPML files and kick off ingestion
  • OPML parser to read RSS feeds
  • Ingestion module to download and parse RSS using feedburner
  • Logging module for better information about ingestion
  • Mongo database integration
Assets 2
Loading