Skip to content
No description, website, or topics provided.
Ruby
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
ruby
.gitignore
Gemfile
Gemfile.lock
README.md
test

README.md

crowdfunder_scraper

This is a small library to scrape data off a (to be unnamed) crowdfunding website. The code is here mostly for instructional purposes.

Please see the accompanying blog posts: https://monogreen.home.blog/2019/11/05/scraping-a-crowd-funding-platform-for-fun-and-non-profit-part-1/

Usage:

To run a scraper, go into any language-specific subdirectoy: "$ cd ruby" Depending on the language, you might need to do setup: "$ rvm install 2.6.0 && bundle" Then just run the script from bash with the url to be scraped: "$ ./scrape_crowdfunder http://example.com" All scripts should also have options, use the usual to see them: "$ ./scrape_crowdfunder --help"

Tests:

Tests are in the top-level directory. Set up the Ruby environment: "$ rvm install 2.6.0 && bundle" Then just run it for each implementation: "$ ./test ruby/scrape_crowdfunder"

Any feedback welcome! Find me on monogreen.de or here on Github.

You can’t perform that action at this time.