-
Notifications
You must be signed in to change notification settings - Fork 199
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Yaml emitter error while executing scans concurrently #2064
Comments
SAS-3303 |
I think the best at this stage would be to follow your intuition and see if indeed you can make it work, then we'll gladly welcome a PR. At this point, using the package in a fastAPI app hasn't really been a use-case we've tested or given much thought about so if you think you're on to something we're open to support you through that PR. Otherwise, I'll be more than happy to log-in a feature request for you and understand a bit more the use-case and so on. |
Gotchya! Good to know that about FastAPI as a use case. We've only just started the integration. So nothing in prod yet. But happy to say it's been pretty smooth sailing thus far. Save for this one thorny issue. I'd be happy to take a crack at it though, and see if I can't figure out what's going on here. |
Hmm I have seen this before with parallel scan executions - we were trying to parallelize partitioned scans, where we loaded config and checks from files and then passed those into multiple parallel scans. I did not find a quick root-cause fix but I found a way to make it work - I started adding config and checks as strings to scans (i.e. separate object instances) instead of one file stream object. This solved the issue for me, but it seems like you are already doing that. Did you by any chance get the error when you used files instead of yaml strings? |
Any feedback or success on this issue @Electrogenic ? |
@m1n0 I'm not too certain that I'll have the time to dig into this further. Though I'll do my best. |
Hi Soda team.
Background
We are using the
soda-core-trino
version3.3.1
library inside of aFast API
server. The following code works when handling a single request at a time. However, when multiple requests come in at the same time (even just 2), we are running into the Yaml emitter error found in the stacktrace below. I'm wondering if there might be some thread safety issues going on within the ruaml yaml emitter, or in the way it is being used.Stacktrace
Let me know your thoughts, or what else I could do to help. Thank you!
The text was updated successfully, but these errors were encountered: