Skip to content

A simple crawler aimed at eating paginated lists of elements.

License

Notifications You must be signed in to change notification settings

peterdeka/listeater

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

listeater Build Status Coverage Status

A simple crawler aimed at eating paginated lists of elements.

A lot of crawlers exist outside, however i needed a simple and configurable crawler to do the hard job of crawling different list types.

As lists are always the same but list elements are quite different, the element crawl is delegated to your custom function. Every element crawling is run in its own goroutine.

Have fun.

About

A simple crawler aimed at eating paginated lists of elements.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages