You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Maybe I'm reading code wrong, but it looks like it loads the Whisper model at least on every request. Seems like we should have some option of retaining models. I understand massive memory requirements so you may not want them all loaded forever.
The text was updated successfully, but these errors were encountered:
Maybe I'm reading code wrong, but it looks like it loads the Whisper model at least on every request. Seems like we should have some option of retaining models. I understand massive memory requirements so you may not want them all loaded forever.
The text was updated successfully, but these errors were encountered: