Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

e2e: add test specs for oras manifest fetch command #565

Closed
Tracked by #563 ...
qweeah opened this issue Sep 14, 2022 · 0 comments · Fixed by #639
Closed
Tracked by #563 ...

e2e: add test specs for oras manifest fetch command #565

qweeah opened this issue Sep 14, 2022 · 0 comments · Fixed by #639
Labels
E2E testing End-to-end testing related issues or pull requests
Milestone

Comments

@qweeah
Copy link
Contributor

qweeah commented Sep 14, 2022

Happy paths:
Before 0.15.0

  • should fetch a manifest list via a tag
  • should fetch a manifest list via a digest
  • should fetch the descriptor of a manifest via a tag
  • should fetch the descriptor of a manifest via a digest
  • should fetch a manifest with a target platform from a manifest list
  • should fetch the descriptor of a manifest with a target platform
  • should fetch a manifest with platform validation
  • should fetch the descriptor of a manifest with platform validation
  • should fetch a manifest with customized media type
  • should show experimental preview hint in help doc

Before 0.16.0

  • should fetch a manifest to stdout and prettify
  • should fetch a manifest to file and output the descriptor to stdout at the same time
  • should fetch a manifest to file and output the prettified descriptor to stdout

Bad paths:

  • should fail directly if not logged in
  • should fail if no artifact reference provided
  • should fail fetching a not existed image
  • should fail fetching if customized media type is provided but non matched manifest found
@qweeah qweeah added the E2E testing End-to-end testing related issues or pull requests label Sep 14, 2022
@shizhMSFT shizhMSFT added this to the v0.16.0 milestone Sep 17, 2022
@qweeah qweeah modified the milestones: v0.16.0, v0.17.0 Nov 2, 2022
@FeynmanZhou FeynmanZhou modified the milestones: v0.16.1, v1.0.0-rc.1 Jan 3, 2023
TerryHowe pushed a commit to TerryHowe/oras that referenced this issue Feb 2, 2023
This PR includes below changes in the E2E utility package:
1. Enables basic auth in test infra
2. Supports excuting oras or other binaries with fluent-styled runtime
configuring and result matching
3. Introduces `match` packages to validate execution results
4. Added sample test specs for `manifest fetch` command and common OCI
image scenario.

Resolves oras-project#554, resolves oras-project#555, resolves oras-project#556, resolves oras-project#565

Signed-off-by: Billy Zha <jinzha1@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
E2E testing End-to-end testing related issues or pull requests
Projects
No open projects
Status: Done
Development

Successfully merging a pull request may close this issue.

3 participants