Skip to content

Conversation

@destefy
Copy link
Contributor

@destefy destefy commented Jul 19, 2024

Previously, if the call to submit for compilation or to check the model status would fail, then the compilation thread would crash. I added try catch blocks to catch this while still logging the raised errors.

I also added a unit test to cover the case where the call to compilation or status fails.

I also realized that the try catch block around the child thread creation call wasn't actually catching exceptions that happen in the thread, just any exceptions that happen when you create the thread. Since this means that an exception in the child thread won't case the main inference thread to crash, I don't know if we actually need to catch it, but I fixed this to catch exceptions as expected

@destefy destefy self-assigned this Jul 19, 2024
@destefy destefy merged commit 74293cc into main Jul 23, 2024
@destefy destefy deleted the stefan/better-retries branch July 23, 2024 14:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants