Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Relax rules for Amazon ECR tools #4283

Closed
garyluu opened this issue Jun 7, 2021 · 5 comments
Closed

Relax rules for Amazon ECR tools #4283

garyluu opened this issue Jun 7, 2021 · 5 comments
Assignees
Labels
bug gui Issues related to the current GUI. review merged but pending a third party look at whether it makes sense/is working web-service
Milestone

Comments

@garyluu
Copy link
Contributor

garyluu commented Jun 7, 2021

Describe the bug
It's currently difficult to register tools with Amazon ECR because of aggressive checks (both backend and frontend)

To Reproduce
Steps to reproduce the behavior:

  1. Register tool with remote site
  2. Choose Amazon ECR
  3. Try registering with something like https://gallery.ecr.aws/x5g7o3i3/appropriate/curl
  4. See sanity check errors in both the Image Registry and Docker Registry Path

Expected behavior
Should be able to register a tool using an Amazon ECR image like https://gallery.ecr.aws/x5g7o3i3/appropriate/curl

Additional context
Webservice - 1.10.2

UI - 2.7.4

Compose Setup - 1.1

Deploy - 1.10.1

┆Issue is synchronized with this Jira Story
┆fixVersions: Dockstore 1.12
┆friendlyId: DOCK-1815
┆sprint: Sprint 65-Pyjama shark
┆taskType: Story

@garyluu garyluu added bug web-service gui Issues related to the current GUI. labels Jun 7, 2021
@pgroves
Copy link

pgroves commented Jun 8, 2021

(I originally brought up this issue on the Discourse forum)

You could also consider a 'catch all' option that takes any valid docker url, which is the underlying requirement of wdl. For instance, we have some old images like: hub.ncsa.illinois.edu/phyloflow/pyclone hosted on our own hub. I don't think it makes sense for dockstore to try to hardcode a menu option for every small hub like that.

Thank you for your fast response.

@unito-bot
Copy link

➤ Denis Yuen commented:

There are three main tasks, which will need to be split up

  1. Workflows can point at ECR tools, make sure these work with features like checksum harvesting or digests. Also take a look at the tools tab or the dag tab which display names of Docker images used by a workflow
  2. Tools on Dockstore should already have the ability to be registered based on ECR, but the regular expression is probably too strict based on the newer version of ECR
  3. Peter Grove (below) ran into an example with a “custom” Docker hub. We’ll need to brainstorm/storytime this one

@unito-bot
Copy link

➤ Kathy.Tran commented:

This ticket implements part 1. For part 1, finish getting tools tab and dag tab so they display the names of the images.

Checksum harvesting for public registries is split out into another ticket ( #4330 ) (requires more brainstorming).

For this ticket (part 1), can also add to docs that we couldn’t implement checksum harvesting for ECR images after some research.

Part 2 is split into another ticket ( #4331 ).

Part 3 is split into a completely different ticket ( #4332 ) (unrelated to Amazon ECR).

@denis-yuen denis-yuen added this to the 1.12 milestone Jun 30, 2021
kathy-t added a commit that referenced this issue Jul 8, 2021
#4283
* Display Amazon ECR images in Tools tab and DAG tab
@unito-bot unito-bot added the review merged but pending a third party look at whether it makes sense/is working label Jul 8, 2021
@NatalieEO
Copy link
Contributor

NatalieEO commented Aug 12, 2021

Registered a tool that used an amazon ecr image and was able to see it appear in the DAG and Tools tabs
Webservice - 93a88e0

UI - 2.8-44-g95bc00b5

Compose Setup - abf5bef

Deploy - 1.11.0-30-gb6b2d89

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug gui Issues related to the current GUI. review merged but pending a third party look at whether it makes sense/is working web-service
Projects
None yet
Development

No branches or pull requests

6 participants