Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve data model of data sets #713

Open
hackdna opened this issue Sep 23, 2015 · 6 comments
Open

Improve data model of data sets #713

hackdna opened this issue Sep 23, 2015 · 6 comments
Labels
dataset important metadata server technical debt
Projects
Technical Debt Model Updates

Comments

@hackdna
Copy link
Member

hackdna commented Sep 23, 2015

Existing data model is extremely inefficient causing request timeouts and crashes due to exhausted memory. For example:

  • importing certain ISA archives takes 15-20 minutes on modern hardware
  • deleting 67 Assay objects via Django admin UI resulted in httpd process crash after running for 15 minutes and consuming over 21GB of memory
@hackdna
Copy link
Member Author

hackdna commented Sep 23, 2015

Related to #710 and #463

@jkmarx jkmarx mentioned this issue Dec 15, 2015
Closed
14 tasks
@jkmarx
Copy link
Member

jkmarx commented Dec 15, 2015

Dataset Browser Enhancements

@hackdna
Copy link
Member Author

hackdna commented Jan 13, 2016

Related issues: #842 and #843.

@hackdna
Copy link
Member Author

hackdna commented Jan 13, 2016

Improve data model of data sets

@jkmarx jkmarx modified the milestone: Next Feb 18, 2016
@jkmarx
Copy link
Member

jkmarx commented Feb 22, 2016

Dataset Browser Enhancements

@scottx611x
Copy link
Member

#713

@scottx611x scottx611x added this to Code in Technical Debt Oct 20, 2017
This was referenced Nov 1, 2018
Closed
Closed
@hackdna hackdna mentioned this issue May 1, 2019
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
dataset important metadata server technical debt
Projects
Model Updates
Awaiting triage
Technical Debt
  
Code
Milestone
No milestone
Development

No branches or pull requests
3 participants
@hackdna @scottx611x @jkmarx