Skip to content

A small example which demonstrates how to use Crawly in order to extract data from JS based website.

Notifications You must be signed in to change notification settings

oltarasenko/autosites

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Autosites

A small example which demonstrates how to use Crawly in order to extract data from JS based website.

Uses meeseeks, as a parses and Splash.

Getting started

  1. Start splash Server locally: docker run -it -p 8050:8050 scrapinghub/splash --max-timeout 300
  2. Run the iex: mix deps.get && iex -S mix
  3. Start the spider itself Crawly.Engine.start_spider(AutotraderCoUK)

About

A small example which demonstrates how to use Crawly in order to extract data from JS based website.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published