Find file
Fetching contributors…
Cannot retrieve contributors at this time
53 lines (50 sloc) 2.32 KB
Name: shpider
Version: 0.1.1
Synopsis: Web automation library in Haskell.
Description:
Shpider is a web automation library for Haskell. It allows you to quickly write crawlers, and for simple cases ( like following links ) even without reading the page source.
.
It has useful features such as turning relative links from a page into absolute links, options to authorize transactions only on a given domain, and the option to only download html documents.
.
It also provides a nice syntax for filling out forms.
.
An example:
.
> runShpider $ do
> download "http://apage.com"
> theForm : _ <- getFormsByAction "http://anotherpage.com"
> sendForm $ fillOutForm theForm $ pairs $ do
> "occupation" =: "unemployed Haskell programmer"
> "location" =: "mother's house"
.
Shpider contains a patched version of the curl package ( the original package's garbage-collection caused non-deterministic behaviour ). The curl licence is therefore distributed with this package.
Category: Web
License: BSD3
License-file: LICENSE
Author: Johnny Morrice
Maintainer: Johnny Morrice <spoon@killersmurf.com>
Homepage: http://github.com/elginer/shpider
Build-type: Configure
Cabal-version: >= 1.2.0
Extra-source-files: LICENSE.CURL, configure, configure.ac, curl.buildinfo.in
Library
Build-depends: base < 5, regex-posix , tagsoup-parsec , url>=2 , containers , tagsoup , mtl , bytestring
Exposed-modules: Network.Shpider.URL
Network.Shpider.Code
Network.Shpider.State
Network.Shpider.Options
Network.Shpider.Links
Network.Shpider.Forms
Network.Shpider.Pairs
Network.Shpider
Other-modules: Network.Shpider.TextUtils
Network.Shpider.Curl.Curl
Network.Shpider.Curl.Types
Network.Shpider.Curl.Opts
Network.Shpider.Curl.Code
Network.Shpider.Curl.Info
Network.Shpider.Curl.Post
Network.Shpider.Curl.Debug
Network.Shpider.Curl.Easy
c-sources: curlc.c
Extra-libraries: curl