Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Spark Submit Visibility #352

Closed
8 tasks
akhurana001 opened this issue Jun 16, 2020 · 0 comments
Closed
8 tasks

Spark Submit Visibility #352

akhurana001 opened this issue Jun 16, 2020 · 0 comments
Assignees
@akhurana001
Labels
bug Something isn't working untriaged This issues has not yet been looked at by the Maintainers
Milestone
0.5.0

Comments

@akhurana001
Copy link
Contributor

Describe the bug
For Spark, the tasks remains Queued till the driver pod comes up. This prevents insight into any submit failures.

Expected behavior
The user should have visibility into submit state and logs for submit attempts.

Flyte component

  • FlytePlugins

To Reproduce
Steps to reproduce the behavior:

  1. ...
  2. ...

Screenshots
If applicable, add screenshots to help explain your problem.

Environment
Flyte component

  • Sandbox (local or on one machine)
  • Cloud hosted
    • AWS
    • GCP
    • Azure
  • Baremetal
  • Other

Additional context
Add any other context about the problem here.
@akhurana001 akhurana001 added bug Something isn't working untriaged This issues has not yet been looked at by the Maintainers labels Jun 16, 2020
@akhurana001 akhurana001 mentioned this issue Jun 16, 2020
Merged
8 tasks
@akhurana001 akhurana001 self-assigned this Jun 17, 2020
@akhurana001 akhurana001 mentioned this issue Jun 17, 2020
Merged
8 tasks
@EngHabu EngHabu closed this as completed Jun 25, 2020
@EngHabu EngHabu added this to the 0.5.0 milestone Jun 25, 2020
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 6, 2022
@hamersaw
Truncate admin event error messages (flyteorg#352)
9147b19 
* truncating admin event error messages to 100KB

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added event recorder unit tests

Signed-off-by: Daniel Rammer <daniel@union.ai>

* removed unnecessary message creation loop in event recorder testing

Signed-off-by: Daniel Rammer <daniel@union.ai>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022
@cosmicBboy @samhita-alla
Single node GPU training example (flyteorg#333) (flyteorg#352)
942ee87 
* update pytorch multi-gpu example, incorporate comments @samhita-alla @kumare3

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* Apply suggestions from code review

Co-authored-by: Samhita Alla <aallasamhita@gmail.com>
Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

Co-authored-by: Samhita Alla <aallasamhita@gmail.com>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022
@olga-union
feat: project domain default page (flyteorg#352)
aaded00 
* feat: project domain default page
* feat: add tests, address feedback
* feat: always render numbers block

Signed-off-by: Olga Nad <olga@union.ai>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022
@flyte-bot
chore(release): Release 0.48.0 [skip ci]
53eb565 
# [0.48.0](http://github.com/lyft/flyteconsole/compare/v0.47.3...v0.48.0) (2022-04-05)

### Features

* project domain default page ([flyteorg#352](http://github.com/lyft/flyteconsole/issues/352)) ([aaded00](http://github.com/lyft/flyteconsole/commit/aaded00accd742ef6cdfb0398e985a0fd8d114f4))
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Jul 24, 2023
@hamersaw
only initializing maptask if there is no failure (flyteorg#352)
8a2f8ca 
Signed-off-by: Daniel Rammer <daniel@union.ai>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Aug 9, 2023
@hamersaw
Truncate admin event error messages (flyteorg#352)
3c94c36 
* truncating admin event error messages to 100KB

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added event recorder unit tests

Signed-off-by: Daniel Rammer <daniel@union.ai>

* removed unnecessary message creation loop in event recorder testing

Signed-off-by: Daniel Rammer <daniel@union.ai>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Aug 21, 2023
@hamersaw
only initializing maptask if there is no failure (flyteorg#352)
94b6510 
Signed-off-by: Daniel Rammer <daniel@union.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@akhurana001 akhurana001

Labels
bug Something isn't working untriaged This issues has not yet been looked at by the Maintainers
Projects
None yet
Milestone
0.5.0
Development

No branches or pull requests
2 participants
@EngHabu @akhurana001