Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add "Adding workflows" section, improve main readme #41

Merged
merged 12 commits into from
Jun 25, 2021

Conversation

mvdbeek
Copy link
Member

@mvdbeek mvdbeek commented Jun 23, 2021

I've written this up while creating #40, so this should include all steps

@mvdbeek mvdbeek changed the title Add "Adding workflows" section to workflows/README.md Add "Adding workflows" section, improve main readme Jun 23, 2021
Copy link
Contributor

@bernt-matthias bernt-matthias left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great

README.md Outdated

Workflows are categorized in the [workflows](workflows/) directory, and listed in [Dockstore](https://dockstore.org/organizations/iwc) and [WorkflowHub](https://workflowhub.eu/search?utf8=%E2%9C%93&q=IWC#workflows).

All workflows are reviewed and tested before and after publication, follow [best practices](https://planemo.readthedocs.io/en/latest/best_practices_workflows.html) and contain explicit versions and rich metadata, including:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why "after publication"?

Maybe repace "and contain" by ", contain"

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We're going to test those workflows regularly, but let me make that more specific


To import IWC workflows into your Galaxy instance use the TRS workflow search in the Galaxy interface.
Click on "Workflows", "Import" and click on the "search form" link.
![Workflow Import GIF](static/iwc-import.gif)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The gif is cool. Would be even better if the workflows that are shown as result of the search would have a description.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, that's a problem with gxformat2, I think. I'll update the gif once that's done.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interestingly, the organization column also doesn't get populated, but this info is available.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, the vue component needs a little kick :)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also seek4science/seek#637 would give us a chance to explore organizations. If you want to thumb up that issue maybe it'll move up the priorities ? 😄

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@OlegZharkov maybe?

README.md Outdated

## Becoming a IWC member

Everyone is welcome and can help out with reviewing or creating workflows. Post a comment [here](https://github.com/galaxyproject/iwc/issues/4) with your expertise and we will add you to the IWC organization.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds a bit as if reviewing and creating workflows is only possible as IWC member.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Right, I'll rewrite that to say Everyone is welcome and can help out with reviewing workflows.

@wm75
Copy link
Contributor

wm75 commented Jun 24, 2021

Really nice!

In line 12 of the workflows/ README, you could maybe link directly to https://planemo.readthedocs.io/en/latest/test_format.html instead of to the planemo github repo?

@wm75
Copy link
Contributor

wm75 commented Jun 24, 2021

In the ro-crate section, it's a bit unclear whom the script is for, i.e. who's supposed to generate the data?

@mvdbeek
Copy link
Member Author

mvdbeek commented Jun 24, 2021

Yeah, let me move that into the deployment process, we can autogenerate this. The fewer things people need to submit the better IMO. We could probably even autogenerate the .dockstore.yml file, but that is a shortcut for planemo to find directories that should become a repository, so we do need this right now.

README.md Outdated Show resolved Hide resolved

To import IWC workflows into your Galaxy instance use the TRS workflow search in the Galaxy interface.
Click on "Workflows", "Import" and click on the "search form" link.
![Workflow Import GIF](static/iwc-import.gif)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add a note under that animation saying: when searching against workflowhub.eu, please use organization:"IWC Workflows" as the search term?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This needs to be fixed on the workflowhub side. iwc is the right organization name.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you have a workflowhub account ? I do, but I can't log in, hanging in a loop. If you do, maybe you could submit the form https://workflowhub.eu/home/feedback ?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Finally managed it in a private session.
Screenshot 2021-06-24 at 16 37 26

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well, yes and no:

  1. I don't quite understand what dockstore is doing either: when you look at the WFs returned by the organization:iwc query, they all list "iwc-workflows" as the organization (though undoubtedly we're iwc on the dockstore website). Not sure whether the query only works accidentally (organization:workflows seems to be working just as well).
  2. Until this is unified upstream, we might still want to provide working instructions here (and simplify it later)?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Alright, with Denis' response I looked a bit closer, and searching for iwc-workflows should also return our workflows. So galaxyproject/galaxy#12196 fixes that in Galaxy. So then I guess it's somewhat consistent. I updated the gif too.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For information, when I follow exactly the gif instructions (Galaxy search form), the search works only with "iuc" and fails if I add "-workflows" or anything after "iuc"

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, yeah, that will be fixed in galaxyproject/galaxy#12196

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@drosofff quoting the organization name is what's working right now, i.e. organization:"iwc-workflows" for dockstore and organization:"IWC Workflows" for workflowhub.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've deployed the update to usegalaxy.org, so organization:iwc-workflows works there.

mvdbeek and others added 7 commits June 25, 2021 10:19
Co-authored-by: Wolfgang Maier <maierw@posteo.de>
And mention that they don't need to be generated right now.
Looking at this more closely I think we should move the RO-Crate
generation to either planemo-ci-action, or planemo itself.
@mvdbeek
Copy link
Member Author

mvdbeek commented Jun 25, 2021

Would be even better if the workflows that are shown as result of the search would have a description

Hope that'll be fixed with galaxyproject/dockstore-galaxy-interface#19

README.md Outdated Show resolved Hide resolved
Co-authored-by: Wolfgang Maier <maierw@posteo.de>
@mvdbeek
Copy link
Member Author

mvdbeek commented Jun 25, 2021

I'm gonna go with @bernt-matthias' approval :). We can (and should) revisit this whenever we have updates. Thanks for the reviews @bernt-matthias @wm75 @drosofff!

@mvdbeek mvdbeek merged commit 59a104a into galaxyproject:main Jun 25, 2021
@mvdbeek mvdbeek mentioned this pull request Jun 25, 2021
28 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants