Skip to content
A web automation library for Haskell
Failed to load latest commit information.
Network Added License text to package Nov 14, 2010
.gitignore
LICENSE
LICENSE.CURL Use git. Why not before? Nov 14, 2010
README Tried to fix looks of readme Nov 14, 2010
Setup.hs Use git. Why not before? Nov 14, 2010
config.log
config.status Created README Nov 14, 2010
configure
configure.ac Use git. Why not before? Nov 14, 2010
curl.buildinfo
curl.buildinfo.in
curlc.c Use git. Why not before? Nov 14, 2010
shpider.cabal Updated to 0.1.1 Nov 14, 2010

README

Shpider.  Copyright 2009-2010 John Morrice.

Shpider is a web automation library for Haskell.   It allows you to quickly write crawlers, and for simple cases ( like following links ) even without reading the page source.
    
It has useful features such as turning relative links from a page into absolute links, options to authorize transactions only on a given domain, and the option to only download html documents.

It also provides a nice syntax for filling out forms.

An example:

runShpider $ do
   download "http://apage.com/"
   theForm : _ <- getFormsByAction "http://anotherpage.com/"
   sendForm $ fillOutForm theForm $ pairs $ do
   "occupation" =: "unemployed Haskell programmer"
   "location" =: "mother's house"

Something went wrong with that request. Please try again.