Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: Improve logging of unhandled exceptions in taps/targets #6641

Open
WillDaSilva opened this issue Aug 17, 2022 · 1 comment
Open

Comments

@WillDaSilva
Copy link
Member

Feature scope

CLI (options, error messages, logging, etc.)

Description

Original Slack thread (private channel): https://meltano.slack.com/archives/C01V5RPLLN4/p1660633635134939

For context, this tweet identified a longstanding issue where taps and targets that do not use our SDK may have uncaught exceptions that are printed to stderr, then propagated to Meltano at the INFO log level, which leads to log output like this:

image

To handle these cases generally without requiring the extensions use our SDK (and by extension, structured logging), we may be able to override sys.excepthook in their Python processes to communicate the exception back to Meltano, where it can be logged in an appropriate manner.

@stale
Copy link

stale bot commented Aug 1, 2023

This has been marked as stale because it is unassigned, and has not had recent activity. It will be closed after 21 days if no further activity occurs. If this should never go stale, please add the evergreen label, or request that it be added.

@stale stale bot added the stale label Aug 1, 2023
@WillDaSilva WillDaSilva added this to the Improve Meltano Logging milestone Aug 1, 2023
@stale stale bot removed the stale label Aug 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: 💡 Rough Idea
Archived in project
Status: No status
Development

No branches or pull requests

3 participants