Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Indicate number of steps in a dynamic job when using map #12539

Open
dagsir bot opened this issue Feb 24, 2023 · 1 comment
Open

Indicate number of steps in a dynamic job when using map #12539

dagsir bot opened this issue Feb 24, 2023 · 1 comment

Comments

@dagsir
Copy link

dagsir bot commented Feb 24, 2023

Issue from the Dagster Slack

This issue was generated from the slack conversation at: https://dagster.slack.com/archives/C01U5LFUZJS/p1676934262622809?thread_ts=1676934262.622809&cid=C01U5LFUZJS


Conversation excerpt

U03JNASG5RC: It would be a nice to have addition if Dagit would show the total count of dynamic jobs when using map. You can get this information but having it clearly visible would be nice. Alternatively showing in advance all the nodes would work too, at the moment it only shows the running nodes.
U028M11QNDD: Thanks Chris for the feedback! Agree that this would be nice--I'd recommend filing an issue for this so we can add it to our backlog
U03JNASG5RC: <@U018K0G2Y85> issue Indicate number of ops in a dynamic job when using map
image


Message from the maintainers:

Do you care about this too? Give it a 👍. We factor engagement into prioritization.

@sryza sryza changed the title Indicate number of ops in a dynamic job when using map Indicate number of steps in a dynamic job when using map Apr 22, 2023
@sryza sryza added this to Untriaged in Dagster UI/UX via automation Apr 22, 2023
@bengotow
Copy link
Collaborator

Hey folks! Thanks for filing this -- right now, Dagster doesn't know before the run starts how many instances of a dynamic output will exist, so we can't show the number in advance. We actually see the steps kick off and add boxes as they're arriving.

I think if the .map emitted some sort of log message indicating how many it was going to start we might be able to show the boxes moments earlier, but still not before the job is launched.

@bengotow bengotow moved this from Untriaged to Needs Discussion in Dagster UI/UX Apr 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Needs discussion
Dagster UI/UX
Needs Discussion
Development

No branches or pull requests

1 participant