This repository has been archived by the owner on Aug 4, 2020. It is now read-only.

Commits

Commits on Jan 12, 2012

Added example of how scrape works in 0.0.8.
rsdoiel
committedJan 12, 2012
Updated example to reflect 0.0.8 revisions.
rsdoiel
committedJan 12, 2012
Cleanup example.
rsdoiel
committedJan 12, 2012
Update examples to reflect release 0.0.8.
rsdoiel
committedJan 12, 2012
Cleanup code to prep for running npm publish.
R. S. Doiel
committedJan 12, 2012
Removed some commented code.
R. S. Doiel
committedJan 12, 2012
Major change in parameter order, options comes before callback. Callbacks have an enviroment object passed as the third paramter.
R. S. Doiel
committedJan 12, 2012
Working on bring code up to jsDom 2.10.
rsdoiel
committedJan 12, 2012

Commits on Jan 11, 2012

Started documenting how I want extractor.ClusteredSpider() to work.
rsdoiel
committedJan 11, 2012

Commits on Jan 10, 2012

Great big duh moment. Realized their is a url.resolve() method I can use in processLink() function. Fixed spider exampled.
R. S. Doiel
committedJan 10, 2012

Commits on Jan 9, 2012

Added simple test for formatRecord() to spider example.
rsdoiel
committedJan 9, 2012

Commits on Jan 8, 2012

Getting ready to convert examples/spider.js to module and stubbing for tests.
rsdoiel
committedJan 8, 2012
Renamed clustered-spider.js to spider.js
rsdoiel
committedJan 8, 2012
Noodling on extractor code debating if cluster-spider.js should become part of the module.
rsdoiel
committedJan 8, 2012

Commits on Jan 7, 2012

Added option to set the name of the database and to use at least two threads.
rsdoiel
committedJan 7, 2012
Continue to refine clustered-spider.js example.
R. S. Doiel
committedJan 7, 2012

Commits on Jan 6, 2012

Added support for restrict path, implemented opt processing. Fixed bug in handling https links.
R. S. Doiel
committedJan 6, 2012
Start integrated opt in cluster-spider.js example.
rsdoiel
committedJan 6, 2012

Commits on Jan 5, 2012

Fixed a relative url problem for links beginning with hash.
R. S. Doiel
committedJan 5, 2012
Revised handling of relative links in Spidered page. Update cluster-spider.js example.
R. S. Doiel
committedJan 5, 2012
Fixed bug in handling http response. Added clustered-spider.js example.
R. S. Doiel
committedJan 5, 2012
Added support for passing back the http(s) response to the callback in FetchPage()
R. S. Doiel
committedJan 5, 2012
Passing tests again as 0.0.7d.
R. S. Doiel
committedJan 5, 2012
Added test to make sure that all anchors get processed.
rsdoiel
committedJan 5, 2012
Added test to make sure that all anchors get processed.
rsdoiel
committedJan 5, 2012

Commits on Dec 16, 2011

Adding placeholder for SubmitForm docs.
rsdoiel
committedDec 16, 2011

Commits on Dec 14, 2011

Fixed bugs with GET versus POST in SubmitForm. Updated tests.
R. S. Doiel
committedDec 14, 2011
Found several bugs in SubmitForm. GET is not being assembled properly (being treated like POST). Port number is still not being set correctly for https prototocol. Still need to figure out what is …
rsdoiel
committedDec 14, 2011
Fixed default port in SubmitForm when protocol is https.
rsdoiel
committedDec 14, 2011
Added SubmitForm() method and consolidated code in FetchPage() in simplified timeout code.
rsdoiel
committedDec 14, 2011
Tagged 0.0.6b. Successfully pushed to npm as 0.0.6b.
rsdoiel
committedDec 14, 2011
Bumped version to 0.0.6b for publishing via npm.
rsdoiel
committedDec 14, 2011
Really did want an anonymous function in jsDom processing rather then manually hosting function as pushItem.
rsdoiel
committedDec 14, 2011

Commits on Dec 13, 2011

Fixed version number in extractor.js and extractor_test.js. Not currently passing test.
rsdoiel
committedDec 13, 2011

Commits on Dec 12, 2011

Added example of a simple clustered spider implementation.
rsdoiel
committedDec 12, 2011