Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Out of sort memory errors in Job and JobResult list views with MySQL backend #3787

Closed
grelleum opened this issue May 20, 2023 · 1 comment · Fixed by #3788
Closed

Out of sort memory errors in Job and JobResult list views with MySQL backend #3787

grelleum opened this issue May 20, 2023 · 1 comment · Fixed by #3788
Assignees
@grelleum
Labels
type: bug Something isn't working as expected

Comments

@grelleum
Copy link
Contributor

Environment

  • Nautobot version (Docker tag too if applicable): 1.5.16
  • Python version: 3.8.13
  • Database platform, version: MySQL 8.0.29

Steps to Reproduce

  1. Run a significant number of large SSoT jobs.
  2. Navigate to the Jobs list view: /extras/jobs
  3. Navigate to the Job-results list view: /extras/job-results

Expected Behavior

Job or job result list view should load.

Observed Behavior

OperationalError at /extras/jobs/
(1038, 'Out of sort memory, consider increasing server sort buffer size')

Error during template rendering
{% include 'extras/inc/job_label.html' with result=result %}
grelleum added a commit to grelleum/nautobot that referenced this issue May 20, 2023
@grelleum
Fix MySQL Out of sort memory error in Job and JobResult list views (n…
9958b8d 
…autobot#3787)
grelleum added a commit to grelleum/nautobot that referenced this issue May 21, 2023
@grelleum
Fix MySQL Out of sort memory error in Job list views (nautobot#3787)
ffdb010
@grelleum grelleum mentioned this issue May 21, 2023
Merged
7 tasks
@glennmatthews glennmatthews added the type: bug Something isn't working as expected label May 22, 2023
@glennmatthews
Copy link
Contributor

I wonder to what extent the changes in #3669 already mitigate this issue.

bryanculver pushed a commit that referenced this issue May 30, 2023
@grelleum @glennmatthews
Fix MySQL Out of sort memory error in Job list views (#3787) (#3788)
7ffed89 
* Fix MySQL Out of sort memory error in Job list views (#3787)

* Add docstring to 'latest_result' property.

* Update nautobot/extras/models/jobs.py

Co-authored-by: Glenn Matthews <glenn.matthews@networktocode.com>

* Removed trailing whitespace in docstring.

* Defer loading json 'data' field in 'JobResultBulkDeleteView'.

---------

Co-authored-by: Glenn Matthews <glenn.matthews@networktocode.com>
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Aug 29, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@grelleum grelleum

Labels
type: bug Something isn't working as expected
Projects
No open projects
Nautobot Core ⚙️
Archived in project
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix MySQL Out of sort memory error in Job list views (#3787) grelleum/nautobot
2 participants
@glennmatthews @grelleum