Skip to content
rails app for web scraping purposes. It scrapes a given page (by the URL), and returns you all informations about that page.
Ruby HTML JavaScript CSS
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
app
bin
config
db
lib
log
public
spec
test
vendor/assets
.gitignore
.rspec
Gemfile
Gemfile.lock
LICENSE
README.md
README.rdoc
Rakefile
config.ru

README.md

scrappet-rest-api

rails app for web scraping purposes. It scrapes a given page (by the URL), and returns you all informations about that page. This API use my own gem https://github.com/davidesantangelo/webinspector

see in action

You can use scrappet-rest-api live at this url: https://scrappet.herokuapp.com

getting started

git clone https://github.com/davidesantangelo/scrappet-rest-api.git
cd scrappet-rest-api & bundle install
rails s

try it

curl -X GET http://127.0.0.1:3000/api/scrape?url=http://www.github.com
return a json hash with title, description, keywords, links, images etc..

You can’t perform that action at this time.