Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unable to load the "mod-openvino" module #8

Closed
merasmus44 opened this issue Dec 19, 2023 · 53 comments
Closed

unable to load the "mod-openvino" module #8

merasmus44 opened this issue Dec 19, 2023 · 53 comments

Comments

@merasmus44
Copy link

After opening Audacity with this module enabled, it says "Error: DLL initialization failed" and it won't load this module at all. I'm using audacity 3.4.2, and I followed all the steps exactly. I tried uninstalling and reinstalling audacity, then following the step again, but that didn't help and gave me the same error. How do I fix this?

@RyanMetcalfeInt8
Copy link
Contributor

RyanMetcalfeInt8 commented Dec 19, 2023

Hi @merasmus44,

Sorry you're having trouble. Something that I'm finding out as we go along is that some Windows installs do not have the required VC redistributable's installed by default. Could you try downloading / installing https://aka.ms/vs/17/release/vc_redist.x64.exe?

(and that is from here: https://learn.microsoft.com/en-US/cpp/windows/latest-supported-vc-redist?view=msvc-170)

Once installed, open Audacity and go to Preferences/Modules, change 'mod-openvino' back to Enabled, close and re-open it. Do you still see the error?

Thanks,
Ryan

@merasmus44
Copy link
Author

It still fails even after installing and restarting my computer.

@RyanMetcalfeInt8
Copy link
Contributor

Hi @merasmus44, which version of Windows are you running? And just double checking that you're using x64 version of Audacity.

Something that I typically use to debug DLL load issues is: https://github.com/lucasg/Dependencies/releases/tag/v1.11.1

For example, if you download Dependencies_x64_Release.zip, run DependenciesGUI.exe, and drag modules/mod-openvino.dll, it should (hopefully) give more information about the reason why mod-openvino.dll is failing to load.

@merasmus44
Copy link
Author

I'm running windows 10, and I do have x64 version of audacity. When I put mod-openvino.dll into the gui, it tells me that it can't find audacity.exe and other various DLLs that all exist in the parent folder (the one with audacity.exe in it). If I move the DLL from the modules folder to the parent folder, it no longer shows any errors, but audacity won't recognize it.

@RyanMetcalfeInt8
Copy link
Contributor

RyanMetcalfeInt8 commented Dec 20, 2023

hmm, can you open a cmd.exe session, and do the following? (Just adjust where you 'cd' to, in case you have Audacity installed someplace else, and you may need to adjust path to your DependenciesGUI.exe)

image

cd "C:\Program Files\Audacity"

set Path="C:\Program Files\Audacity";%Path%

%userprofile%\Downloads\Dependencies_x64_Release\DependenciesGUI.exe modules\mod-openvino.dll

And then send me screenshot of the Dependencies GUI, for example here is mine:
image

Thanks!
Ryan

@merasmus44
Copy link
Author

sorry for the late reply
screenshot

@RyanMetcalfeInt8
Copy link
Contributor

Hmm, did you open a cmd-prompt and set Path environment as I showed in previous comment? That should have made openvino.dll (and other DLL's) to show as resolved.

@merasmus44
Copy link
Author

I did set the path variable in the last screenshot, and I did it again just before posting this to double check and I got the same result.

@RyanMetcalfeInt8
Copy link
Contributor

Hi @merasmus44, sorry for the delayed response. I don't really understand what is happening here, and why it doesn't work as expected.

Can you give a screenshot of your Audacity folder (the one containing Audacity.exe)?

@merasmus44
Copy link
Author

I had to upload 2 pictures because my screen is small.
1
2

@Tecytic
Copy link

Tecytic commented Jan 3, 2024

Hello. I have encountered the same problem.
I already did the step of installing the vc_redist64 dll
In the step of "%userprofile%\Downloads\Dependencies_x64_Release\DependenciesGUI.exe modules\mod-openvino.dll" fail about the path. Mi downloads folder is in D: partition and I don't know how to modify the path
Captura2
Captura1

@RyanMetcalfeInt8
Copy link
Contributor

Hi @merasmus44 & @Tecytic,

Sorry, I made a mistake in my instructions. Can you try cmd.exe commands again, but without adding quotes to set Path=... step:

cd "C:\Program Files\Audacity"

set Path=C:\Program Files\Audacity;%Path%

%userprofile%\Downloads\Dependencies_x64_Release\DependenciesGUI.exe modules\mod-openvino.dll

@Tecytic, if you can find DependenciesGUI.exe with windows explorer, you can right-click (or shift-right-click on Windows 10) and choose "Copy as path", and paste that into the cmd.exe window (replacing what I have above, %userprofile%\Downloads\Dependencies_x64_Release\DependenciesGUI.exe)

Thanks,
Ryan

@Tecytic
Copy link

Tecytic commented Jan 3, 2024

After your instructions...

image
image
image

@RyanMetcalfeInt8
Copy link
Contributor

Hi @Tecytic, which version of Windows are you using?

@Tecytic
Copy link

Tecytic commented Jan 3, 2024

Audacity instaled today for experimet with this module
image

@RyanMetcalfeInt8
Copy link
Contributor

RyanMetcalfeInt8 commented Jan 3, 2024

@Tecytic, let me see if I can dig up a similar system to try on. I see that you are running on an Intel Core i7 CPU 920, which is pretty old at this point (~2008). I know that OpenVINO only claims support for Intel Core 6th Gen (~2015 version) and later, but I'm not sure if this would trigger some kind of DLL initialization error (which is what I translated from one of your screenshots).

@merasmus44, what CPU are you running on?

@merasmus44
Copy link
Author

merasmus44 commented Jan 3, 2024

Intel(R) Celeron(R) N5100 @ 1.10GHz (laptop)

@MissMixi
Copy link

MissMixi commented Jan 7, 2024

Was checking the threads to find an issue kind of the same as mine before making a new thread and I also have trouble getting OpenVINO to work but I get this window pop up instead :( Followed all the instructions but still unable to get it to work
Audacity Error

PC Information -

Device name: DESKTOP-LTINANU
Processor: AMD Ryzen 9 5900X 12-Core Processor 3.70 GHz
Installed RAM: 32.0 GB
Device ID: BAD810F0-35E8-4821-BFFE-61CE4B308F17
Product ID: 00325-80000-00000-AAOEM
System type: 64-bit operating system, x64-based processor
Pen and touch Pen support

Edition: Windows 10 Home
Version: 22H2
Installed on: ‎12/‎12/‎2020
OS build: 19045.3803
Experience: Windows Feature Experience Pack 1000.19053.1000.0

@RyanMetcalfeInt8
Copy link
Contributor

RyanMetcalfeInt8 commented Jan 8, 2024

Hi @MissMixi,

... but I get this window pop up instead

Strange. After googling this error message, results seem to imply that it can happen if there is a mismatch between architecture & DLL types (32 / 64-bit). But in your case I do see that you are on a 64-bit processor / OS, so I'm not sure why it's throwing this error.

And just to double confirm -- you're using 64-bit version of Audacity?

@merasmus44 -- sorry for delayed response. I'm not sure what exactly is going wrong. I think to debug some of these initialization error cases, I'm going to write some kind of isolated test executable. So I'll probably share that in the next day or so.

Thanks,
Ryan

@RyanMetcalfeInt8
Copy link
Contributor

Hi @merasmus44, @Tecytic, @MissMixi,

If you have time, can you try something that might help to give some initial results about whether OpenVINO is loading properly or not.

First, download copy the following .exe (hello_query_device.exe) to the same folder where Audacity.exe is installed (e.g. C:\Program Files\Audacity):

hello_query_device.exe

Then, open a cmd.exe shell, cd to the Audacity directory and run hello_query_device.exe:
image

If it succeeds, you should get a list of 'available devices'. For example, my (abridged) output:

C:\Program Files\Audacity>hello_query_device.exe
[ INFO ] Build ................................. 2023.1.0-12185-9e6b00e51cd-releases/2023/1
[ INFO ]
[ INFO ] Available devices:
[ INFO ] CPU
[ INFO ]        SUPPORTED_PROPERTIES:
[ INFO ]                Immutable: AVAILABLE_DEVICES : ""
[ INFO ]                Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[ INFO ]                Immutable: RANGE_FOR_STREAMS : 1 22
[ INFO ]                Immutable: FULL_DEVICE_NAME : Intel(R) Core(TM) Ultra 7 165H
[ INFO ]                Immutable: OPTIMIZATION_CAPABILITIES : FP32 FP16 INT8 BIN EXPORT_IMPORT
[ INFO ]                Mutable: NUM_STREAMS : 1
[ INFO ]                Mutable: AFFINITY : HYBRID_AWARE
[ INFO ]                Mutable: INFERENCE_NUM_THREADS : 0
[ INFO ]                Mutable: PERF_COUNT : NO
[ INFO ]                Mutable: INFERENCE_PRECISION_HINT : f32
[ INFO ]                Mutable: PERFORMANCE_HINT : LATENCY
[ INFO ]                Mutable: EXECUTION_MODE_HINT : PERFORMANCE
[ INFO ]                Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 0
[ INFO ]                Mutable: ENABLE_CPU_PINNING : YES
[ INFO ]                Mutable: SCHEDULING_CORE_TYPE : ANY_CORE
[ INFO ]                Mutable: ENABLE_HYPER_THREADING : YES
[ INFO ]                Mutable: DEVICE_ID : ""
[ INFO ]                Mutable: CPU_DENORMALS_OPTIMIZATION : NO
[ INFO ]                Mutable: CPU_SPARSE_WEIGHTS_DECOMPRESSION_RATE : 1
...

Thanks in advance!
Ryan

@Tecytic
Copy link

Tecytic commented Jan 10, 2024

image
image

@petapika
Copy link

Hi @merasmus44, @Tecytic, @MissMixi,

If you have time, can you try something that might help to give some initial results about whether OpenVINO is loading properly or not.

Here's what I get...

PS C:\Program Files (x86)\Audacity> .\hello_query_device.exe
[ INFO ] Build ................................. 2023.1.0-12185-9e6b00e51cd-releases/2023/1
[ INFO ]
[ INFO ] Available devices:
[ INFO ] CPU
[ INFO ] SUPPORTED_PROPERTIES:
[ INFO ] Immutable: AVAILABLE_DEVICES : ""
[ INFO ] Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[ INFO ] Immutable: RANGE_FOR_STREAMS : 1 8
[ INFO ] Immutable: FULL_DEVICE_NAME : Virtual CPU @ 1.00GHz
[ INFO ] Immutable: OPTIMIZATION_CAPABILITIES : FP32 FP16 INT8 BIN EXPORT_IMPORT
[ INFO ] Mutable: NUM_STREAMS : 1
[ INFO ] Mutable: AFFINITY : NONE
[ INFO ] Mutable: INFERENCE_NUM_THREADS : 0
[ INFO ] Mutable: PERF_COUNT : NO
[ INFO ] Mutable: INFERENCE_PRECISION_HINT : f32
[ INFO ] Mutable: PERFORMANCE_HINT : LATENCY
[ INFO ] Mutable: EXECUTION_MODE_HINT : PERFORMANCE
[ INFO ] Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 0
[ INFO ] Mutable: ENABLE_CPU_PINNING : YES
[ INFO ] Mutable: SCHEDULING_CORE_TYPE : ANY_CORE
[ INFO ] Mutable: ENABLE_HYPER_THREADING : YES
[ INFO ] Mutable: DEVICE_ID : ""
[ INFO ] Mutable: CPU_DENORMALS_OPTIMIZATION : NO
[ INFO ] Mutable: CPU_SPARSE_WEIGHTS_DECOMPRESSION_RATE : 1
[ INFO ]
[ INFO ] GNA
[ INFO ] SUPPORTED_PROPERTIES:
[ INFO ] Immutable: AVAILABLE_DEVICES : GNA_SW
[ INFO ] Immutable: OPTIMAL_NUMBER_OF_INFER_REQUESTS : 1
[ INFO ] Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[ INFO ] Immutable: OPTIMIZATION_CAPABILITIES : INT16 INT8 EXPORT_IMPORT
[ INFO ] Immutable: FULL_DEVICE_NAME : GNA_SW
[ INFO ] Immutable: GNA_LIBRARY_FULL_VERSION : 3.5.0.2116
[ INFO ] Mutable: GNA_DEVICE_MODE : GNA_SW_EXACT
[ INFO ] Mutable: PERFORMANCE_HINT : LATENCY
[ INFO ] Mutable: LOG_LEVEL : LOG_NONE
[ INFO ] Immutable: EXECUTION_DEVICES : GNA
[ INFO ] Mutable: GNA_SCALE_FACTOR_PER_INPUT : ""
[ INFO ] Mutable: GNA_FIRMWARE_MODEL_IMAGE : ""
[ INFO ] Mutable: GNA_HW_EXECUTION_TARGET : UNDEFINED
[ INFO ] Mutable: GNA_HW_COMPILE_TARGET : UNDEFINED
[ INFO ] Mutable: GNA_PWL_DESIGN_ALGORITHM : UNDEFINED
[ INFO ] Mutable: GNA_PWL_MAX_ERROR_PERCENT : 1.000000
[ INFO ] Mutable: INFERENCE_PRECISION_HINT : undefined
[ INFO ] Mutable: EXECUTION_MODE_HINT : ACCURACY
[ INFO ] Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 1
[ INFO ]
PS C:\Program Files (x86)\Audacity>

@merasmus44
Copy link
Author

[ INFO ] Build ................................. 2023.1.0-12185-9e6b00e51cd-releases/2023/1
[ INFO ]
[ INFO ] Available devices:
[ INFO ] CPU
[ INFO ] SUPPORTED_PROPERTIES:
[ INFO ] Immutable: AVAILABLE_DEVICES : ""
[ INFO ] Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[ INFO ] Immutable: RANGE_FOR_STREAMS : 1 4
[ INFO ] Immutable: FULL_DEVICE_NAME : Intel(R) Celeron(R) N5100 @ 1.10GHz
[ INFO ] Immutable: OPTIMIZATION_CAPABILITIES : FP32 FP16 INT8 BIN EXPORT_IMPORT
[ INFO ] Mutable: NUM_STREAMS : 1
[ INFO ] Mutable: AFFINITY : NONE
[ INFO ] Mutable: INFERENCE_NUM_THREADS : 0
[ INFO ] Mutable: PERF_COUNT : NO
[ INFO ] Mutable: INFERENCE_PRECISION_HINT : f32
[ INFO ] Mutable: PERFORMANCE_HINT : LATENCY
[ INFO ] Mutable: EXECUTION_MODE_HINT : PERFORMANCE
[ INFO ] Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 0
[ INFO ] Mutable: ENABLE_CPU_PINNING : YES
[ INFO ] Mutable: SCHEDULING_CORE_TYPE : ANY_CORE
[ INFO ] Mutable: ENABLE_HYPER_THREADING : YES
[ INFO ] Mutable: DEVICE_ID : ""
[ INFO ] Mutable: CPU_DENORMALS_OPTIMIZATION : NO
[ INFO ] Mutable: CPU_SPARSE_WEIGHTS_DECOMPRESSION_RATE : 1
[ INFO ]
[ INFO ] GNA
[ INFO ] SUPPORTED_PROPERTIES:
[ INFO ] Immutable: AVAILABLE_DEVICES : GNA_SW
[ INFO ] Immutable: OPTIMAL_NUMBER_OF_INFER_REQUESTS : 1
[ INFO ] Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[ INFO ] Immutable: OPTIMIZATION_CAPABILITIES : INT16 INT8 EXPORT_IMPORT
[ INFO ] Immutable: FULL_DEVICE_NAME : GNA_SW
[ INFO ] Immutable: GNA_LIBRARY_FULL_VERSION : 3.5.0.2116
[ INFO ] Mutable: GNA_DEVICE_MODE : GNA_SW_EXACT
[ INFO ] Mutable: PERFORMANCE_HINT : LATENCY
[ INFO ] Mutable: LOG_LEVEL : LOG_NONE
[ INFO ] Immutable: EXECUTION_DEVICES : GNA
[ INFO ] Mutable: GNA_SCALE_FACTOR_PER_INPUT : ""
[ INFO ] Mutable: GNA_FIRMWARE_MODEL_IMAGE : ""
[ INFO ] Mutable: GNA_HW_EXECUTION_TARGET : UNDEFINED
[ INFO ] Mutable: GNA_HW_COMPILE_TARGET : UNDEFINED
[ INFO ] Mutable: GNA_PWL_DESIGN_ALGORITHM : UNDEFINED
[ INFO ] Mutable: GNA_PWL_MAX_ERROR_PERCENT : 1.000000
[ INFO ] Mutable: INFERENCE_PRECISION_HINT : undefined
[ INFO ] Mutable: EXECUTION_MODE_HINT : ACCURACY
[ INFO ] Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 1
[ INFO ]
[ INFO ] GPU
[ INFO ] SUPPORTED_PROPERTIES:
[ INFO ] Immutable: AVAILABLE_DEVICES : 0
[ INFO ] Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 2 1
[ INFO ] Immutable: RANGE_FOR_STREAMS : 1 2
[ INFO ] Immutable: OPTIMAL_BATCH_SIZE : 1
[ INFO ] Immutable: MAX_BATCH_SIZE : 1
[ INFO ] Immutable: DEVICE_ARCHITECTURE : GPU: vendor=0x8086 arch=v11.0.0
[ INFO ] Immutable: FULL_DEVICE_NAME : Intel(R) HD Graphics Gen11 (iGPU)
[ INFO ] Immutable: DEVICE_UUID : 00000000000000000000000000000000
[ INFO ] Immutable: DEVICE_LUID : 0000000000000000
[ INFO ] Immutable: DEVICE_TYPE : integrated
[ INFO ] Immutable: DEVICE_GOPS : {f16:614.4,f32:307.2,i8:307.2,u8:307.2}
[ INFO ] Immutable: OPTIMIZATION_CAPABILITIES : FP32 BIN FP16 EXPORT_IMPORT
[ INFO ] Immutable: GPU_DEVICE_TOTAL_MEM_SIZE : 3330088960
[ INFO ] Immutable: GPU_UARCH_VERSION : 11.0.0
[ INFO ] Immutable: GPU_EXECUTION_UNITS_COUNT : 24
[ INFO ] Immutable: GPU_MEMORY_STATISTICS : ""
[ INFO ] Mutable: PERF_COUNT : NO
[ INFO ] Mutable: MODEL_PRIORITY : MEDIUM
[ INFO ] Mutable: GPU_HOST_TASK_PRIORITY : MEDIUM
[ INFO ] Mutable: GPU_QUEUE_PRIORITY : MEDIUM
[ INFO ] Mutable: GPU_QUEUE_THROTTLE : MEDIUM
[ INFO ] Mutable: GPU_ENABLE_LOOP_UNROLLING : YES
[ INFO ] Mutable: GPU_DISABLE_WINOGRAD_CONVOLUTION : NO
[ INFO ] Mutable: CACHE_DIR : ""
[ INFO ] Mutable: PERFORMANCE_HINT : LATENCY
[ INFO ] Mutable: EXECUTION_MODE_HINT : PERFORMANCE
[ INFO ] Mutable: COMPILATION_NUM_THREADS : 4
[ INFO ] Mutable: NUM_STREAMS : 1
[ INFO ] Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 0
[ INFO ] Mutable: INFERENCE_PRECISION_HINT : f16
[ INFO ] Mutable: DEVICE_ID : 0
[ INFO ]

@RyanMetcalfeInt8
Copy link
Contributor

Hi @merasmus44, @petapika, @Tecytic, @MissMixi,

Thanks for helping with the first round of experiments. It helps to know that OpenVINO is able to run fine on your systems in a standalone environment (outside of Audacity, without the complexity of the stuff I'm stacking on top).

If you could help with a second round of experiments, the information shared by you will be extremely useful in narrowing down this 'unable to load module' error.

First, download this zip file:
Audacity-OpenVINO-AI-TestMods.zip

In here, you'll find 4 folders:

noise_suppression
whisper_transcription
music_separation
music_generation

And in each of these folders, there is a mod-openvino.dll.

For each of these folders, can you take the mod-openvino.dll and overwrite the one that came with Audacity-OpenVINO-2023.2-Module-3.4.2-R1.zip? For example, if Audacity is installed here: C:\Program Files\Audacity, you will find original mod-openvino.dll here: C:\Program Files\Audacity\modules\mod-openvino.dll

Each time you overwrite a new DLL, you'll need to:

  1. Open Audacity
  2. In Edit->Preferences->Modules, change 'mod-openvino' to 'Enabled' (as it will reset to 'New' when it detects that the DLL has been overwritten).
  3. Close, and re-open Audacity.

I would recommend trying the DLL's in the following order.

  1. Noise Suppression

    If it works, you should be able to find OpenVINO Noise Suppression in effects menu:
    noise_suppression

  2. Whisper Transcription

    If it works, you should be able to find OpenVINO Whisper Transcription in analyzers menu:
    whisper

  3. Music Separation

    If it works, you should be able to find OpenVINO Music Separation in effects menu:
    music_separation

  4. Music Generation

    If it works, you should be able to find OpenVINO Music Generation in generators menu:
    music_generation

And for each of these DLLs, if you could just tell me whether it worked or not, and any short description of what went wrong in the case it doesn't work.

For example:

Noise Suppression: Worked
Whisper Transcription: Worked
Music Separation: Didn't work (unable to load the "mod-openvino" module, initialization failed)
Music Generation: Didn't work (unable to load the "mod-openvino" module, initialization failed)

Thank you all very much for your time and support!

Best Regards,
Ryan

@mballem
Copy link

mballem commented Jan 15, 2024

Hi @RyanMetcalfeInt8

I followed the instructions on replacing the 'mod-openvino.dll' files, and all of them resulted in an error."

whisper_transcription: Unable to load the 'mod-openvino' module. Error - A dynamic link library (DLL) initialization routine failed.

The other files resulted in an error that opened a window with the error log; it is included in the file.
erro.log.txt
aud-error

@RyanMetcalfeInt8
Copy link
Contributor

Hi @mballem,

Thanks for sharing your results. Would you mind also trying the 'hello_query_device' experiment, described above (#8 (comment))?

Also, what kind of hardware setup are you running (CPU / GPU), and OS (looks like Windows 10 from your log)?

Thanks,
Ryan

@mballem
Copy link

mballem commented Jan 16, 2024

Hi @RyanMetcalfeInt8.

When executing "hello_query_device" I got the following response:

C:\Program Files\Audacity>hello_query_device.exe
[ INFO ] Build ................................. 2023.1.0-12185-9e6b00e51cd-releases/2023/1
[ INFO ]

C:\Program Files\Audacity>

O.S Windows 10;
CPU AMD Phenom II X6 1055T (Socket AM3);
GPU AMD Radeon R7 370;

@RyanMetcalfeInt8
Copy link
Contributor

Hi @mballem,

Okay, looks like even standalone OpenVINO sample is failing in your case. You might want to try downloading the release zip file / re-extracting it, just to be sure that there isn't a corrupted file or something.

Thanks,
Ryan

@mballem
Copy link

mballem commented Jan 16, 2024

Hi @RyanMetcalfeInt8.
Unfortunately, it didn't work.
I uninstalled Audacity and installed it again, downloaded the zips again, and the same error persists.
Perhaps there is some compatibility issue with my CPU, as it is quite an old hardware.
Thanks for trying to help me with this.

@petapika
Copy link

Hi @merasmus44, @petapika, @Tecytic, @MissMixi,

Thanks for helping with the first round of experiments. It helps to know that OpenVINO is able to run fine on your systems in a standalone environment (outside of Audacity, without the complexity of the stuff I'm stacking on top).

If you could help with a second round of experiments, the information shared by you will be extremely useful in narrowing down this 'unable to load module' error.

I tried all 4. All worked except Whisper which had the same "unable to load mod-openvino" as the original report.

This is on Win11 Pro aarch64 virtualized on QEMU with UTM on a Macbook Pro M1 max.

I haven't tried the actual Noise Supression Effect to see if it actually works on my audio sample, but I will do that next.

FWIW, I tried openvino on a 2015 intel macbook with Windows 10 pro running on Virtualbox and openvino worked and processed a WAV file.

Sorry it took so long to get to this. Let me know if I can help with anything else.

Cheers and thanks for all you're doing to get this working!

@Tecytic
Copy link

Tecytic commented Jan 16, 2024

OK
Noise supression: worked
Whisper transcription
image
Music separation Worked. (Slow. 50 min to encode 2 min song, but... amazing)
Music generator: worked at the beggining, but...
image
Log:
19:04:39: Audacity 3.4.2
19:04:39: Error: Failed to load shared library 'avformat-60.dll' (error 126: No se puede encontrar el módulo especificado.)
19:04:39: Error: Failed to load shared library 'avformat-59.dll' (error 126: No se puede encontrar el módulo especificado.)
19:04:39: Error: Failed to load shared library 'avformat-58.dll' (error 126: No se puede encontrar el módulo especificado.)
19:04:39: Error: Failed to load shared library 'avformat-57.dll' (error 126: No se puede encontrar el módulo especificado.)
19:04:39: Error: Failed to load shared library 'avformat-55.dll' (error 126: No se puede encontrar el módulo especificado.)
19:04:43: sqlite3 message: (1) no such table: project in "SELECT 1 FROM project LIMIT 1;"
19:04:43: Error: Failed to load shared library 'avformat-60.dll' (error 126: No se puede encontrar el módulo especificado.)
19:04:43: Error: Failed to load shared library 'avformat-59.dll' (error 126: No se puede encontrar el módulo especificado.)
19:04:43: Error: Failed to load shared library 'avformat-58.dll' (error 126: No se puede encontrar el módulo especificado.)
19:04:43: Error: Failed to load shared library 'avformat-57.dll' (error 126: No se puede encontrar el módulo especificado.)
19:04:43: Error: Failed to load shared library 'avformat-55.dll' (error 126: No se puede encontrar el módulo especificado.)
19:06:19: Error: In Music Generation, exception: Exception from src\inference\src\core.cpp:134:
[ GENERAL_ERROR ] Check 'layout.bytes_count() <= get_device_info().max_alloc_mem_size' failed at src\plugins\intel_gpu\src\runtime\ocl\ocl_engine.cpp:134:
[GPU] Exceeded max size of memory object allocation: Requested 536870912 bytes but max alloc size is 536805376 bytes

19:07:44: Operation 'OpenVINO Music Generation' took 54,334000 seconds. Poll was called 108 times and took 0,176424 seconds. Yield was called 108 times and took 0,098436 seconds.

@RyanMetcalfeInt8
Copy link
Contributor

Hi @Tecytic, @petapika,

Thank you so much! So looks like, in terms of DLL load issues, the culprit is whisper -- so this is very useful info.

Best Regards,
Ryan

@Supergum
Copy link

Supergum commented Feb 25, 2024

Hey Ryan, the second testmod "Whisper Transcription" was not working, all the other worked!

This is my pc.

Apparaatnaam DESKTOP-I6L23H0
Processor Intel(R) Core(TM) i7 CPU 860 @ 2.80GHz 2.93 GHz
Geïnstalleerd RAM-geheugen 12,0 GB
Apparaat-id 04528611-E220-49DB-991A-2F55DC3990EF
Product-id 00326-10000-00000-AA622
Type systeem 64-bits besturingssysteem, x64-processor

Winver 10 22H2

@aauro
Copy link

aauro commented Mar 2, 2024

Hi there, Don't know if this can be of any help. Feel free to ignore
I'm also having problem with the Whisper model. Followed steps above and even reinstalled all from scratch a couple of times. My machine is somewhat old as well. Yet I run a docker of Whishper (yes spelled right) which is a web interface for the whisper models. I was running in crashes all times, until I tried an updated version with the newest whisper models. And then it worked. Not sure if it was that the new model per se or some other changes. I'm not a programmer but thought of sharing this experience.

@RyanMetcalfeInt8
Copy link
Contributor

Hi @Supergum, @aauro, all

Thanks! I was finally able to reproduce this on a machine that doesn't support AVX/AVX2. The culprit is whisper.dll (from whisper.cpp). The default build for whisper.cpp enabled AVX/AVX2 instructions by default, and so this becomes problematic in the DLL load routines when running on a system that doesn't support this instruction set.

@Holomatrix263
Copy link

I have to add to this. At first I had OpenVINO running on an AMD 6 Core & was running well. The motherboard went on me, so I had to switch to a Xeon processor, and have had the same error ever since: Unable to load the "mod-openvio" module. Error: A dynamic link library (DLL) initialization routine failed

My original rig was:
Motherboard: AM3+ Socket = Asus M5A97 LE R2.0
CPU: AMD FX-6300 Black Edition 6-Core 3.50GHZ
8GB RAM
Windows 10 Pro

Swapped to:
Motherboard: ASUS P6T Deluxe
CPU: Intel(R) Xeon(R) CPU X5670 @ 2.93GHz
24GB RAM
Windows 10 Pro = (it's actually the same install)

Since the motherboard chipset & firmware drivers were done & device manager was clean of errors, tried Audacity & Intel VINO wouldn't initialise anymore.

Tried to fully reinstall x64 Audacity, as well as try the modified DLL files above, still the same, would go from Enabled to FAILED. Unfortunately I'm guessing the CPU instruction set on the older processors are not capable of it?

Unfortunate, as I was about 400 mp3's in removing guitar from songs so I can use them in guitar practice: https://www.youtube.com/watch?v=KDllcgfUbIk (the sheer power of this 4 branch restemming is, game changing). 🥰😎

@RyanMetcalfeInt8
Copy link
Contributor

RyanMetcalfeInt8 commented Mar 14, 2024

Hi @Holomatrix263,

Sorry to hear that the plugins stopped working when you swapped to that older Xeon processor.

Unfortunately I'm guessing the CPU instruction set on the older processors are not capable of it?

Correct, the specs of that processor show that it only supports Instruction Set Extensions of SSE4.2. (it currently requires AVX2)

I'm still considering ways to potentially resolve this, or at least isolate the issue to whisper... as this is by far the most commonly reported issue.

Thanks,
Ryan

@aauro
Copy link

aauro commented Mar 14, 2024

Hi @Supergum, @aauro, all

Thanks! I was finally able to reproduce this on a machine that doesn't support AVX/AVX2. The culprit is whisper.dll (from whisper.cpp). The default build for whisper.cpp enabled AVX/AVX2 instructions by default, and so this becomes problematic in the DLL load routines when running on a system that doesn't support this instruction set.

My CPU supports AVX though: Intel(R) Core(TM) i7-3610QM

@RyanMetcalfeInt8
Copy link
Contributor

Hi @aauro,

My CPU supports AVX though: Intel(R) Core(TM) i7-3610QM

Right, your CPU supports AVX but not AVX2.

@vljlangen
Copy link

Dear Ryan,

Thank you for all your efforts and the support you provide to everyone here. I encountered the same DLL issue as well, but running music_separation was seamless, thanks to your distribution of DLL files for different actions above.

I would recommend mentioning/including that file directly in the README of this repository, with an explanation that if the plug-in does not run otherwise, some of the functions might work if tested separately. My rationale is that since the whisper service tends to crash but can be used without issues via Google Colaboratory, it's not as crucial as some other tools in your repository.

Once again, thank you very much for your invaluable contribution.

@RyanMetcalfeInt8
Copy link
Contributor

Hi @vljlangen,

I'm glad you were able to use some of the 'trimmed down' DLL's to bypass the issues related to whisper.dll! I had considered posting a something to the README, etc. -- maybe I still will -- I had made a fix for this that will be included in the next release (which will be installer based), so I've been trying to get that pushed out.

Thanks!
Ryan

@RyanMetcalfeInt8
Copy link
Contributor

Hi all!

Our new release is available here: https://github.com/intel/openvino-plugins-ai-audacity/releases/tag/v3.5.0-R2

This release should resolve 'module load' issues for x86 CPUs that do not have AVX / AVX2 support.

I'm going to close this issue for now, but feel free to keep commenting if you have questions / want to share results. Otherwise, please file a new issue if you have trouble with the updated release. Cheers!

Ryan

@Holomatrix263
Copy link

Hi Ryan,
Feedback = can confirm it's now working correctly as expected on:
SUS P6T Deluxe
CPU: Intel(R) Xeon(R) CPU X5670 @ 2.93GHz
24GB RAM
Windows 10 Pro

THANK YOU so much for the work, it's faster too! (encoding a 4:54 track in approximately 6 minutes).

Many Thanks
Holomatrix

@jairovs2002
Copy link

I installed it from the zip file and it worked correctly. An Audacity update came out, I installed it and saw that it didn't work in this version. I uninstalled, deleted the files in "Roaming", "local" and so on. I installed the previous version and the error message appeared. I downloaded the openvino EXE and it worked correctly again. I hope it helps.

@omarelganzoury
Copy link

hy
i have the latest version of audacity windows 10 x64 after installing it ti tell me mugwal not found or perseager not found
i trayed every thing pleas help

@RyanMetcalfeInt8
Copy link
Contributor

Hi @omarelganzoury, if you are using latest version of Audacity (3.5.1), please download and install this version of the plugins: https://github.com/intel/openvino-plugins-ai-audacity/releases/tag/v3.5.1-R2.1

@omarelganzoury
Copy link

omarelganzoury commented May 6, 2024 via email

@RyanMetcalfeInt8
Copy link
Contributor

Hi @omarelganzoury,

I'll need some more information then. I'm not sure what you mean by 'it tells me codnt be found'. Can you post a screenshot of the error?

Thanks,
Ryan

@omarelganzoury
Copy link

omarelganzoury commented May 6, 2024 via email

@RyanMetcalfeInt8
Copy link
Contributor

Hi @omarelganzoury,

It looks like the screenshot didn't come through correctly. But, I suspect that perhaps your system is missing OpenCL.dll, which may be causing a 'the specified module can not found' error.

Can you try the following?

  1. Download this: https://github.com/KhronosGroup/OpenCL-SDK/releases/download/v2023.04.17/OpenCL-SDK-v2023.04.17-Win-x64.zip

  2. Inside this zip folder, inside bin folder, you'll find OpenCL.dll. Can you try copying this into your Audacity folder?

  3. Re-set Audacity module to 'Enabled' in preferences, and restart Audacity.

Our installer doesn't package / distribute this, as we've found it to be included by Windows on all systems we've been testing. But recently we realized that may not necessarily be the case for all Windows installations... anyway, let me know if that resolves your issue.

@omarelganzoury
Copy link

omarelganzoury commented May 6, 2024 via email

@sanvalerich
Copy link

Раян! Привет из России, город Нижний Тагил Свердловской области! Дружище, вы так мне помогли! Я слепой человек и ни как не мог справиться с openwino. А когда вставил в папку Audacity файлик из вашего архива, то всё заработало. Спасибо вам за ваш труд!

@RyanMetcalfeInt8
Copy link
Contributor

Раян! Привет из России, город Нижний Тагил Свердловской области! Дружище, вы так мне помогли! Я слепой человек и ни как не мог справиться с openwino. А когда вставил в папку Audacity файлик из вашего архива, то всё заработало. Спасибо вам за ваш труд!

Great to hear! Cheers!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests