Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flink Swallows Pipeline Errors #27

Closed
ranchodeluxe opened this issue Jan 15, 2024 · 2 comments
Closed

Flink Swallows Pipeline Errors #27

ranchodeluxe opened this issue Jan 15, 2024 · 2 comments
Assignees
@ranchodeluxe
Labels
enhancement New feature or request

Comments

@ranchodeluxe
Copy link
Collaborator

ranchodeluxe commented Jan 15, 2024 •
edited
Loading

Problem

LocalDirectBakery experience will show where/when things go wrong in pipelines. For recent recipe runs it show that we generate a ton of botocore.exceptions.ConnectionError subclasses during runs. Flink does not show us any of this information for some reason 😞

Possible Solution

No idea, but we need to figure this out or we won't have any good information about why pipelines fail
@ranchodeluxe ranchodeluxe added the enhancement New feature or request label Jan 15, 2024
@ranchodeluxe ranchodeluxe mentioned this issue Jan 16, 2024
Closed
8 tasks
@ranchodeluxe
Copy link
Collaborator Author

Tim Hodson at USGS is seeing the same thing for a data point

@ranchodeluxe ranchodeluxe self-assigned this Jan 25, 2024
@ranchodeluxe
Copy link
Collaborator Author

closing this and moving here: pangeo-forge/pangeo-forge-cloud-federation#20

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ranchodeluxe ranchodeluxe

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ranchodeluxe