Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

From nsidc cumulus 3220: Create a new send-pan task #3416

Merged
merged 65 commits into from
Jul 28, 2023

Conversation

jennyhliu
Copy link
Contributor

@jennyhliu jennyhliu commented Jun 23, 2023

Summary: Summary of changes

Addresses CUMULUS-3220: Create a new send-pan task for use in SIPS workflows

Original user PR: #3320

Changes

  • Created a new send-pan task

PR Checklist

  • Update CHANGELOG
  • Unit tests
  • Ad-hoc testing - Deploy changes and test manually
  • Integration tests

jennyhliu and others added 30 commits March 10, 2023 15:06
In `cumulus/packages/pvl` the exports were located in `t.js` and
`index.js` was empty. This was causing a dependency failure in
`cumulus/packages/api/models/pdrs.js`, which uses
`require('@cumulus/pvl')`.

At the same time, `cumulus/tasks/parse-pdr/index.js` had been
configured to use `require('@cumulus/pvl/t')` in order to get around
the empty PVL `index.js` file.

This commit moves `t.js` to `index.js` and updates the `require` in
the parse-pdr task.
Downgrade the `got` package to 11.8.6. The 12.x version was converted
to native ESM and no longer supports CommonJS `require`.
Fixed pdr replacement so we replace only instances of .pdr
* Update xml2js 0.4.22->0.5 strict

* Address GHSA-776f-qx25-q3cc/update allow list

* Update CHANGELOG

* Update package pins to 0.5.0 for xmljs

Co-authored-by: Jonathan Kovarik <kovarik@nsidc.org>
…horization header (#3341)

* CUMULUS-3285: Updated isAuthBearTokenRequest  to handle non-Bearer authorization header

* add integration test
* backport PR

* finalizing docs and changing remaining groups

* 15.1.0 release

* doc updates

* PR feedback + testing changes

* Revert "doc updates"

This reverts commit 5037012.

* PR feedback

* reverting change

* Revert "update changelog"

This reverts commit ae4627c.

* reverting changes

* PR feedback

* removing EgressLambda from doc

* Update xml2js 0.4.22->0.5 strict (#3330) (#3339)

* Update xml2js 0.4.22->0.5 strict

* Address GHSA-776f-qx25-q3cc/update allow list

* Update CHANGELOG

* Update package pins to 0.5.0 for xmljs

Co-authored-by: Jonathan Kovarik <kovarik@nsidc.org>

* PR feedback

* PR feedback

* PR feedback

* fixing documentation linting

* PR feedback

* PR feedback

* PR feedback

* adding variables to tf-modules/workflow

* PR feedback

* PR feedback

* reverting previous change

* CUMULUS-3121/3120 v15.1.0 backport (#3346)

* backport PR

* finalizing docs and changing remaining groups

* PR feedback + testing changes

* PR feedback

* reverting change

* Revert "update changelog"

This reverts commit ae4627c.

* reverting changes

* PR feedback

* removing EgressLambda from doc

* Update xml2js 0.4.22->0.5 strict (#3330) (#3339)

* Update xml2js 0.4.22->0.5 strict

* Address GHSA-776f-qx25-q3cc/update allow list

* Update CHANGELOG

* Update package pins to 0.5.0 for xmljs

Co-authored-by: Jonathan Kovarik <kovarik@nsidc.org>

* PR feedback

* PR feedback

* PR feedback

* fixing documentation linting

* PR feedback

* PR feedback

* PR feedback

* adding variables to tf-modules/workflow

* PR feedback

* PR feedback

* reverting previous change

---------

Co-authored-by: jennyhliu <34660846+jennyhliu@users.noreply.github.com>
Co-authored-by: Jonathan Kovarik <kovarik@nsidc.org>

* changing version number

* small fixes

* small fix

---------

Co-authored-by: jennyhliu <34660846+jennyhliu@users.noreply.github.com>
Co-authored-by: Jonathan Kovarik <kovarik@nsidc.org>
* CUMULUS-3243:Updated granule delete logic to delete granule which is not in DynamoDB

* add unit tests
Key: panKey,
});
expect(panExists).toEqual(true);
deleteS3Object(config.bucket, panKey);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
deleteS3Object(config.bucket, panKey);
await deleteS3Object(config.bucket, panKey);

* @param {object} params
* @param {string} params.localPath - the full local file path
* @param {string} params.uploadPath - the full remote file path for uploading file to
* @param {string} params.remoteAltBucket - alternate per-file bucket override to this.bucket
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* @param {string} params.remoteAltBucket - alternate per-file bucket override to this.bucket
* @param {string} [params.remoteAltBucket] - alternate per-file bucket override to this.bucket

https://jsdoc.app/tags-param.html

*
* @param {object} event - a Cumulus Message
* @param {object} context - an AWS Lambda context
* @returns {Promise<object>} - Returns output from task.
Copy link
Member

@botanical botanical Jul 26, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* @returns {Promise<object>} - Returns output from task.
* @returns {Promise<CumulusMessageWithAssignedPayload | CumulusRemoteMessage>} - Returns output from task.

I believe it should be returning a CumulusMessage?

Copy link
Member

@botanical botanical left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for ushering in these changes @jennyhliu 🙇

@jennyhliu jennyhliu merged commit 8b66897 into master Jul 28, 2023
@jennyhliu jennyhliu deleted the from-nsidc-CUMULUS-3220 branch July 28, 2023 16:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants