Skip to content
This repository

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP

MurmuringSpider is a concise Twitter crawler with DataMapper

branch: master

Fetching latest commit…

Octocat-spinner-32-eaf2f5

Cannot retrieve the latest commit at this time

Octocat-spinner-32 lib
Octocat-spinner-32 spec
Octocat-spinner-32 .gitignore
Octocat-spinner-32 .rspec
Octocat-spinner-32 .travis.yml
Octocat-spinner-32 Gemfile
Octocat-spinner-32 Guardfile
Octocat-spinner-32 LICENSE
Octocat-spinner-32 README.md
Octocat-spinner-32 Rakefile
Octocat-spinner-32 murmuring_spider.gemspec
README.md

MurmuringSpider

Build Status

MurmuringSpider is a concise Twitter crawler.

When we write a data-mining / text-mining application based on twitter's timeline, we have to collect and store tweets first.

I am irritated with writing such crawler repeatedly, so I wrote this.

What you have to do is only to add query and to run them periodically.

Thanks to consistent Twitter API and twitter gem, it is quite easy to track various types of timelines (such as user_timeline, home_timeline, search...)

Installation

Add this line to your application's Gemfile:

gem 'murmuring_spider'

And then execute:

$ bundle

Or install it yourself as:

$ gem install murmuring_spider

Usage

Usage of murmuring spider — Gist

Contributing

  1. Fork it
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Added some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request
Something went wrong with that request. Please try again.