Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release/0.6.0 #54

Merged
merged 42 commits into from
Jan 25, 2023
Merged

Release/0.6.0 #54

merged 42 commits into from
Jan 25, 2023

Conversation

jamesfwood
Copy link
Collaborator

[0.6.0]

Added

  • PODAAC-4658
    • Updated jupyter-test workflow to use environment variables
    • Updated jupyter-test workflow to inlcude slack reporting, collections update and removal
  • PODAAC-4659
    • Removed branch restriction from jupyter-test workflow on success notebook pass
    • Updated token handling for association removal
    • Some log formatting for jupyter-test workflow
  • PODAAC-4660
    • Updated cmr-umm-updater to newer version and added input argument to disable association removal
  • PODAAC-4976
    • Added dateutil dependency to Jupyter-test workflow
  • PODAAC-5065
    • Calculate how much shared memory will be used and determine to use multicore or singlecore concise.

Changed

Deprecated

Removed

Fixed

concise bot and others added 30 commits July 21, 2022 17:51
* added collection list extraction to juputer_test WF

* fixed spacing

* added type to WF input

* removed token input

* expanded environment naming tolerance

* renamed collections to cumulus_api to avoid wrong imports

* updated name

* moved files to better positions

* adderd tokenfile location to workflow input

* some lint fix

* init lint disable

* lint fix

* lint...

* more lint

* updated F401 to F0401

* updated flake8 to ignore init.py

* updated workflow with new locations

* - Added cmr-association-diff import and usage
- Added secret usage to workflow
- Added FileHandler class

* removed \

* removed ./ from paths

* changed test execution only if input file exists

Co-authored-by: Zoltan Miskolci <zoltan.miskolci@jpl.nasa.gov>
* update concise notebook to use harmony py and take collection input

* add env variables

* remove env

* update notebook
* - Added env variables to jupyter_test
- Added step notebook file output check
- Added step collection update on successs
- Added step for  slack send

* some testing

* added env variable for notebook

* added temp print test to verify checks

* removed echo

* update

* some update on debug print

* moved echoes to different step

* changed ' to " for echo

* - added slack report steps
- added ops output file check step

* - removed multiple similar id
- removed test file creation

* merged jupyter notebook execution steps

* - Added remove association script
- Added remove failed associations to jupyter-test

* updated secret name

* slack report test

* changed slack payload

* fixed payload format

* removed # from channel name

* test

* removed code

* spacing

* added channel

* added # to channel name

* updated payload

* test payload

* experiment

* updated OPS slack msg payload

* removed demo test code

* updated changelog

* change parameter tag to parameters

* test

* test

* path print

* test

* addded ${{  around  env variables

* added jupyter install to dependencies step

* added dependencies for notebook

* added netcdf4 dependency

* update notebook to concatenate only 2 files so tests is faster

* update variable from collection to collection_id

* variable printouts

* removed output file check

Co-authored-by: Zoltan Miskolci <zoltan.miskolci@jpl.nasa.gov>
Co-authored-by: Simon Liu <simon.liu@jpl.nasa.gov>
…43)

* update notebook to be more robust

* updated jupyter_test workflow

* updated printout

* Update uat_associations.txt with new collections

* Update ops_associations.txt with new collections

* - updated file merging process
- removed checked in txt file changes

* Update uat_associations.txt with new collections

* Update ops_associations.txt with new collections

* fixed a mistype in jupyter-test.yaml

* updated token for removal

* updated changelog

Co-authored-by: Simon Liu <simon.liu@jpl.nasa.gov>
Co-authored-by: Zoltan Miskolci <zoltan.miskolci@jpl.nasa.gov>
Co-authored-by: Phoeneix <Phoeneix@users.noreply.github.com>
- updated changelog

Co-authored-by: Zoltan Miskolci <zoltan.miskolci@jpl.nasa.gov>
* removed collections for demo purposes

* Update uat_associations.txt with new collections

* updated for demo

* Update uat_associations.txt with new collections

* test

* Update uat_associations.txt with new collections

* test

* Update uat_associations.txt with new collections

* test

* fix

* changed tab to space

* added status

* Update uat_associations.txt with new collections

* test

* revert

* Update uat_associations.txt with new collections

* updated status

* Update uat_associations.txt with new collections

* Formating

* consistency

* revert

Co-authored-by: Zoltan Miskolci <zoltan.miskolci@jpl.nasa.gov>
Co-authored-by: Phoeneix <Phoeneix@users.noreply.github.com>
* updated workflow to send slack report as single message

* test msg

* update

* fix

* Update uat_associations.txt with new collections

* test

* removed collection

* test

* added env variable name

* test

* remvoed -e

* Update uat_associations.txt with new collections

* removed http to disable preview

* Update uat_associations.txt with new collections

* updated to final version

Co-authored-by: Zoltan Miskolci <zoltan.miskolci@jpl.nasa.gov>
Co-authored-by: Phoeneix <Phoeneix@users.noreply.github.com>
* - added dateutil dependency
- Updated changelog

* changed dateutil to upgrade at the end

* Update ops_associations.txt with new collections

Co-authored-by: Zoltan Miskolci <zoltan.miskolci@jpl.nasa.gov>
Co-authored-by: Phoeneix <Phoeneix@users.noreply.github.com>
* put a try exception around running multicore, if multicore fails try single core

* fix pyling

* update changelog

* add memory calculation to determine to run single core or multicore

* fix pylint and flake8

* fix how to get a variables byte size
concise bot and others added 12 commits November 22, 2022 18:50
Co-authored-by: Jonathan M Smolenski <smolensk@jpl.nasa.gov>
* Update action version in pipeline. Run poetry update. Bumped to python 3.10

* Update action version in pipeline. Run poetry update. Bumped to python 3.10

* Update build-pipeline.yml

* Update build-pipeline.yml
@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@jamesfwood jamesfwood merged commit d5a53dd into main Jan 25, 2023
@jamesfwood jamesfwood deleted the release/0.6.0 branch January 25, 2023 17:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants