Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP

Loading…

Move Database Over to [Something More Efficient than MongoDB] #3

Closed
bgw opened this Issue · 4 comments

2 participants

@bgw
Owner

MongoDB is great, but for this specific use case, Cassandra looks like a better choice, from a resources perspective.

If someone watching this project has a better idea, or would like to help, let me know.

@bgw
Owner

This needs to be done soon(ish) if I'm going to keep growing the database. It's at 50GB (for about 14 million comments), and while I've got lots of hard-drive space, I don't have an infinite amount.

@markbahnman

Which library are you thinking of using? I'm sure you already know, but pycassa doesn't seem to be supporting python3 yet: pycassa/pycassa#178

I'm not sure how much of a problem that will, but someone on SO recommended using the Python CQL.

@bgw
Owner

Dammit. Maybe I'm better off using SQLAlchemy with PostgreSQL. At least then I get ACID. Plus, assuming I design things right, it should then be able to use SQLite for testing.

@bgw bgw closed this
@bgw
Owner
bgw commented

The coffeescript rewrite will support SQLite, MySQL, and PostgreSQL. When it comes down storage size, MySQL's compression should work well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Something went wrong with that request. Please try again.