You can clone with
HTTPS or Subversion.
pupa is a great framework for scraping data. But I don't like the ever changing database it uses. Yesterday it used mongodb, today it uses postgis, tommorow it'll use something else. It would be great if one could export scraped data to CSV file (or provide some other portable destination source).
Thanks, very informative!
Still, having to install the whole Django thing, setup a database only to write text files is kind of overkill.
@Vanuan I agree, which is why you shouldn't need a Django database to scrape! :)
Just --import :)
If it currently does, it's a bug - we have an open issue #87 about that