Skip to content

[Feature Request] Support for progress and cancellation in compilation APIs #24573

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
adrastogi opened this issue Apr 27, 2025 · 0 comments
Open
Labels
feature request request for unsupported feature or enhancement

Comments

@adrastogi
Copy link

adrastogi commented Apr 27, 2025

Describe the feature request

#24207 introduced a new API for compiling models. Compilation can potentially take many minutes depending on the model, so it would be useful to augment this API to enable reporting progress (e.g., by some higher-level wrapper or caller), as well as cancellation.

Describe scenario use case

The scenario would ultimately be to enable finer-grained control over the compilation API by an application (e.g., perhaps as part of its first-run experience the app needs to compile a model that it's bringing with it, so that subsequent inferences are faster; the app may wish to show progress, and also give the user the opportunity to cancel the operation if they so desire). This would in turn enable the developer to produce a nicer user experience.

cc: @adrianlizarraga

@adrastogi adrastogi added the feature request request for unsupported feature or enhancement label Apr 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request request for unsupported feature or enhancement
Projects
None yet
Development

No branches or pull requests

1 participant