Permalink
Browse files

Updated README

  • Loading branch information...
David Koblas
David Koblas committed Apr 19, 2012
1 parent 99c3df9 commit b82cbec3c4304b158c865b60a96a6859fc1f4554
Showing with 13 additions and 1 deletion.
  1. +13 −1 README.md
View
@@ -1,4 +1,16 @@
spiro
=====
-Tornado Web Crawler
+Tornado Web Crawler
+
+I really just wanted a "simple" web crawlwer, something that could fetch ... say 100,000 pages without breaking a sweat and save
+them to some storage (MongoDB or Riak). This is what I threw together.
+
+Usage
+-----
+
+Looks like a Tornado app.
+
+ ./app.py --debug --port=8000
+
+Point your web browser at it:

0 comments on commit b82cbec

Please sign in to comment.