Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP

Loading…

Divide scraping from saving #109

Closed
Vanuan opened this Issue · 5 comments

3 participants

@Vanuan

pupa is a great framework for scraping data. But I don't like the ever changing database it uses. Yesterday it used mongodb, today it uses postgis, tommorow it'll use something else. It would be great if one could export scraped data to CSV file (or provide some other portable destination source).

@paultag
Owner
@jamesturk
Owner
@Vanuan

Thanks, very informative!

@Vanuan Vanuan closed this
@Vanuan

Still, having to install the whole Django thing, setup a database only to write text files is kind of overkill.

@paultag
Owner

@Vanuan I agree, which is why you shouldn't need a Django database to scrape! :)

Just --import :)

If it currently does, it's a bug - we have an open issue #87 about that

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Something went wrong with that request. Please try again.