[SOLVED] RuntimeError: quantized engine QNNPACK is not supported

[kravetsone]

When I tried to run the example from the documentation I got an error

RuntimeError: quantized engine QNNPACK is not supported

import anyio
from stark import run, CommandsManager, Response
from stark.interfaces.vosk import VoskSpeechRecognizer

from stark.interfaces.silero import SileroSpeechSynthesizer

VOSK_MODEL_URL = "https://alphacephei.com/vosk/models/vosk-model-small-ru-0.22.zip"
SILERO_MODEL_URL = "https://models.silero.ai/models/tts/ru/v4_ru.pt"

recognizer = VoskSpeechRecognizer(model_url=VOSK_MODEL_URL)
synthesizer = SileroSpeechSynthesizer(model_url=SILERO_MODEL_URL)

manager = CommandsManager()

@manager.new('hello')
async def hello_command() -> Response:
    text = voice = 'Hello, world!'
    return Response(text=text, voice=voice)

async def main():
    await run(manager, recognizer, synthesizer)

if __name__ == '__main__':
    anyio.run(main)

OS: Windows 11
CPU: Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz 1.99 GHz
GPU: Intel(R) UHD Graphics 620 / NVIDIA GeForce GTX 1050
stark-engine: 4.0.5
torch: 2.1.0

[kravetsone]

Solution is:

use another torch_backends_quantized_engine. See more

for example, i use onednn.

synthesizer = SileroSpeechSynthesizer(model_url=SILERO_MODEL_URL, torch_backends_quantized_engine="onednn")

and it works!