Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store runs somewhere else #66

Closed
glacials opened this issue Nov 8, 2014 · 1 comment
Closed

Store runs somewhere else #66

glacials opened this issue Nov 8, 2014 · 1 comment
Labels
innards-only Issues invisible to users

Comments

@glacials
Copy link
Owner

glacials commented Nov 8, 2014

We're storing run files as strings in a file column in the runs table. This is messy, because some run files are on the order of 10 Mb in size, so we have to avoid selecting this column when we don't need it to get anywhere near decent performance.

I don't want to get rid of storing the files, because they hold a lot of data that we don't yet duplicate (like history) and we should be able to serve these files in their complete forms. But moving lists of splits themselves into the database, so that we never need to access or parse files unless we're serving them directly, may be a prerequisite to moving files to an external service like AWS without introducing more complexity for file retrieval.

@glacials
Copy link
Owner Author

This should be fixed in a way that also fixes #13.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
innards-only Issues invisible to users
Projects
None yet
Development

No branches or pull requests

1 participant