Skip to content
Commits on Aug 29, 2015
  1. Merge pull request #4 from 2m/wip-fix-tests

    Create a local HTML server for tests.
Commits on Aug 19, 2015
  1. @2m

    Create a local HTML server for tests.

    2m committed
Commits on Aug 10, 2015
  1. Merge branch '2m-wip-bintray'

Commits on Jul 26, 2015
  1. @2m

    Publish to bintray.

    2m committed
Commits on Jul 17, 2015
  1. upgrade components

Commits on Apr 9, 2015
Commits on Jan 7, 2015
Commits on Oct 8, 2014
  1. adding in a utility function for just retrieving a page and getting a…

    … response back, rather than going through the whole nodeStack business.
  2. adding in another discriminator type for the Form element processor, …

    …so that you can look up forms by name.
Commits on Sep 9, 2014
  1. [Fixes #78332762] allow the application to set whether or not to fail…

    … when there is a failing status code.
Commits on Mar 27, 2014
  1. adding a 60 second timeout to the click method so that my crawlers do…

    …n't get gobbled up by lame crawlees.
Commits on Oct 14, 2013
  1. upgrading HTMLUnit to clean up some of the CSS parsing errors. Comple…

    …x selectors were causing the CSS parser to spew errors.
Commits on Sep 23, 2013
  1. SgmlPage is a bit more generic - cast to that class when the result m…

    …ay be either Html or XML.
Commits on Aug 19, 2013
  1. Merge pull request #2 from arturaz/master

    Updated and added #download method
Commits on Aug 16, 2013
  1. @arturaz

    Updated README.

    arturaz committed
  2. @arturaz

    Added sbt-idea plugin to build.

    arturaz committed
  3. @arturaz

    Bump to version 0.6.0.

    arturaz committed
    * Use scala 2.10.2 for building.
    * Code style cleanup.
    * Added #download method.
Commits on Jul 25, 2013
Commits on Apr 30, 2013
  1. upgrade to scala 2.9.1

Commits on Mar 23, 2013
  1. silent CSS error handling.

Commits on Mar 22, 2013
  1. after clicking, ask the web client to wait 1 second for javascript ex…

    …ecutions to finish, then report how many are still running if timeout is reached.
Commits on Mar 20, 2013
  1. adding another configuration bit to the crawler: by default we will u…

    …se insecure SSL when sites require us to access via HTTPS. And a version bump for the crawler.
Commits on Jan 31, 2013
  1. reduce the chatty.

Commits on Jun 24, 2012
  1. pushing the crawler version

  2. Adding in some more settings (and defaults) to the base crawler to ex…

    …pose HTMLUnit WebClient features. Bumping the version to 0.5.0
Commits on Jun 15, 2012
  1. mouseOver addition

  2. bumping the version.

Commits on Jun 11, 2012
  1. adding in logic to detect when a node is not resolved - in which case…

    … we don't want to process the code block that was intended for the unfound node.
Commits on Apr 13, 2012
  1. Make the crawler config into a mutable scala map, rather than a java …

    …map, and in the configure call just add the map passed in to the crawler config rather than overwriting the map. This allows the crawlers to also add in their own bit of config without applications stomping on those settings.
Commits on Apr 7, 2012
Commits on Apr 6, 2012
  1. Made crawl part of the contract for the Crawler class, so that Crawle…

    …r instances may generically just be told to 'crawl'.
  2. added in a method and map that allows configuration to be passed into…

    … the crawlers (rather than imposing config at instantiation time).
Something went wrong with that request. Please try again.