Slow database performance #1

Open
srt4 opened this Issue May 15, 2011 · 1 comment

Projects

None yet

2 participants

@srt4
Collaborator
srt4 commented May 15, 2011

On a regular hard drive, creating all of the users using the create_test_db.sh script takes a long time.

This is because sqlite is very slow with multiple inserts when they are not combined into a transaction. (It runs data integrity checks after writing to the .db file).

We should come up with a way to combine queries into transactions, if at all possible.

@h4rr h4rr was assigned May 15, 2011
@h4rr
Owner
h4rr commented May 15, 2011

I believe that there is no remedy for this issue, and we will have to consider this a design issue relating to development vs production. If we change the createUsers.py to start doing SQL or non-API calls, then we won't be testing the right calls. Eventually we should get to the point where we don't need to run this script often, and/or use schema migration tools such as South after we make an official release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment