Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Omnibus #202

Merged
merged 53 commits into from
Apr 22, 2024
Merged

Omnibus #202

merged 53 commits into from
Apr 22, 2024

Conversation

manning-ncsa
Copy link
Collaborator

@manning-ncsa manning-ncsa commented Apr 21, 2024

Fixes #201 #41 #42 #62 #168

Description of the Change

  • Fixed slow /transients page load caused by redundant database queries fetching progress. Installed Silk profiler to aid this kind of debugging.

  • Fixed issues related to missing host info.

  • Modified CI workflow to use GitHub build cache to speed up the workflow. Revised automated build to push to NCSA Harbor instance.

  • Rebuilt requirements.txt from scratch, updating versions of all dependencies to most recent possible package versions. The update from Django v3 to v5 and bootstrap v3 to v4 required various modifications, including using a POST request for logout and minor tweaks to urls.py. Set ALLOWED_HOSTS and CSRF config in settings.py.

  • Revised login page styling to improve appearance.

  • Fixed broken DOI on acknowledgements page

  • Drastically improved initial app load time by moving run_sbi_blast import statement and bypassing the SBI training set generation if possible by preloading files of pickled training set data.

  • Initialize dustmap data from data archive file

  • Fixed whitespace bug in "no host" status message.

  • Return the transient name when TransientTaskRunner task completes to aid debugging when using Flower.

  • Removes the kubernetes manifests and directory and replaces them with a FAQ entry pointing to our deployment repo with a Helm chart and ArgoCD Application definitions.

djones1040 and others added 30 commits April 18, 2024 10:32
Django updated to v5.0.4.
astro_ghost temporarily installed from Git repo fork.
Parameterized dust and photoz in fork of astro-ghost package
and disabled source download if data already exists.
Downloaded associated data files, uploaded updated archive file
blast-data.v1.tar.gz, and updated data init scripts.
The training sets need only be generated once and are
now included in the initial data archive file.
@manning-ncsa manning-ncsa self-assigned this Apr 21, 2024
@manning-ncsa
Copy link
Collaborator Author

Given that we have not yet fixed the CI workflow, I manually ran the tests for commit a232a2f and they passed.

docker compose --project-name blast -f docker/docker-compose.yml --env-file env/.env.default --env-file env/.env.dev --profile ci up

@manning-ncsa manning-ncsa marked this pull request as ready for review April 22, 2024 21:22
@manning-ncsa manning-ncsa merged commit c9f7985 into main Apr 22, 2024
2 of 4 checks passed
@manning-ncsa manning-ncsa mentioned this pull request Apr 22, 2024
6 tasks
@manning-ncsa manning-ncsa deleted the omnibus branch April 22, 2024 21:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Reduce database queries when loading /transients page
2 participants