Skip to content

tombbl/yawc

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 

Repository files navigation

yawc is yet another web crawler

yawc is a ruby script which uses Mechanize to crawl the sites.
There are still plenty of things to do to make it more robust.

At this moment it works stable. And that is its main advantage :-)

Changes

Earlier

  1. yawc emerged from darkness of its author’s mind
  2. had quite a number of code refactoring
  3. grew with stability improvement and error handling

2012-02-23

  1. User can now terminate yawc in a clean manner by hitting Ctrl+c.
  2. Links are now stored only in absolute form.

About

yet another web crawler based on Mechanize

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages