You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
#24207 introduced a new API for compiling models. Compilation can potentially take many minutes depending on the model, so it would be useful to augment this API to enable reporting progress (e.g., by some higher-level wrapper or caller), as well as cancellation.
Describe scenario use case
The scenario would ultimately be to enable finer-grained control over the compilation API by an application (e.g., perhaps as part of its first-run experience the app needs to compile a model that it's bringing with it, so that subsequent inferences are faster; the app may wish to show progress, and also give the user the opportunity to cancel the operation if they so desire). This would in turn enable the developer to produce a nicer user experience.
Describe the feature request
#24207 introduced a new API for compiling models. Compilation can potentially take many minutes depending on the model, so it would be useful to augment this API to enable reporting progress (e.g., by some higher-level wrapper or caller), as well as cancellation.
Describe scenario use case
The scenario would ultimately be to enable finer-grained control over the compilation API by an application (e.g., perhaps as part of its first-run experience the app needs to compile a model that it's bringing with it, so that subsequent inferences are faster; the app may wish to show progress, and also give the user the opportunity to cancel the operation if they so desire). This would in turn enable the developer to produce a nicer user experience.
cc: @adrianlizarraga
The text was updated successfully, but these errors were encountered: