Unable to load DLL 'onnxruntime.dll': The specified module could not be found. about onnxruntime

[n8allan]

I don't understand why this is closed. Shouldn't the nuget package copy the native file automatically?

[n8allan]

I struggled with this until I fired up "Depends" and discovered that it requires the VC runtime.

[devnet123]

i'm having the same issue on 1.4.2
any suggestion ?

System.TypeInitializationException: The type initializer for 'Microsoft.ML.OnnxR
untime.NativeMethods' threw an exception.
---> System.DllNotFoundException: Unable to load DLL 'onnxruntime' or one of it
s dependencies: The specified module could not be found. (0x8007007E)
at Microsoft.ML.OnnxRuntime.NativeMethods.OrtGetApiBase()
at Microsoft.ML.OnnxRuntime.NativeMethods..cctor()
--- End of inner exception stack trace ---
at Microsoft.ML.OnnxRuntime.SessionOptions..ctor()
at Microsoft.ML.OnnxRuntime.InferenceSession..ctor(String modelPath)
at Microsoft.ML.Transforms.Onnx.OnnxModel..ctor(String modelFile, Nullable1 gpuDeviceId, Boolean fallbackToCpu, Boolean ownModelFile, IDictionary2 shapeDic
tionary)

OS Platform: Windows 7 64bit
ONNX Runtime installed from Nuget Microsoft.ML.OnnxRuntime in VS19
ONNX Runtime version: 1.4.2

[Chase-William]

Having the same issue using AnyCPU - It doesn't download/install the 32bit DLLs and so the project I'm trying to use it fails with System.BadImageFormatException: 'Could not load file or assembly 'Aspose.OCR, Version=21.1.2.0, Culture=neutral, PublicKeyToken=716fcc553a201e56' or one of its dependencies. An attempt was made to load a program with an incorrect format.' (because it loads the 64 bit DLLs)

I downloaded the x86 release zip and was able to place onnxruntime.dll in the right directory (\packages\Microsoft.ML.OnnxRuntime.MKLML.1.4.0\runtimes\win-x86\native\) to (assumedly, since I can't run it) fix it, but I'm not able to find pre-compiled x86 versions of mklml.dll and libiomp5md.dll to see if this would fix it for them as well.

I did some digging to see if I could find a solution to your issue but was unable to locate any x86 binaries. I think your best bet might be to download the source code from Microsoft.ML source code and try to build your desired x86 libs.

Keep in mind not all functionalities when running x86 are supported, specifically TensorFlow and LightGBM. This is stated in the github for ML. Another reference to x86 not being supported here. Who knows what issues might arise when trying to build the lib with your setup so I would suggest migrating your project to x64 if possible.

[Grayda]

I was facing this issue (or possibly a similar issue), and I ended up installing https://www.nuget.org/packages/Microsoft.ML.OnnxRuntime/1.5.2?_src=template which resolved the issue for me.

[nelemans1971]

I've had similar problems with onnxruntime.dll when deploying my application on other computers.

In the end it came down to installing "Visual C++ Redistributable for Visual Studio" (VC_redist.x64.exe & VC_redist.x86.exe). After installing these libraries the problem was resolved and onnxruntime.dll loaded without problems.

[pranavsharma]

@shahasad @jignparm can one of you take a look? thanks!

[shahasad]

Current build is supported for windows 10, x64 CPU only. Support for other platforms are coming in subsequent releases. Meanwhile, please feel free to build from the source.

[sethjuarez]

I built from source but could not find the dll. I’m also running Windows 10 x64.

[jignparm]

The problem is due to the Visual Studio not copying the dependent dlls (onnxruntime.dll and mkldnn.dll )to the \x64\Debug directory. After copying both these files, the project runs successfully.

[sethjuarez]

That is correct! Also the onnx model I exported from the current version of the PyTorch ONNX export uses a version of Gemm in the export that is not compatible.

[tkcrown]

Same issue here.

[shahasad]

Should have been fixed in the later versions. Plz try v0.5

[Ajk4]

I have the same thing on 0.5

[jbrownkramer]

I have the same thing on 1.1.0

[y2kbugger]

You have to set your cpu type to either x86 or x64.

@shahasad @jignparm Perhaps this could be made clearer, maybe build should fail if cpu type is not correctly setup in Visual Studio.

[jignparm]

You have to set your cpu type to either x86 or x64.

I have the same thing on 1.1.0

That should not be the case -- it should work for x86, x64 as well as AnyCPU, depending on which architecture applies to the project (i.e. native C++, .Net Core or .Net Framework).

The package ships with the appropriate targets files, so you should not need to copy any DLLs (the original issue was created prior to the package fixes.)

Can you post a way to reproduce the error?

[y2kbugger]

To be honest I haven't tried to reproduce since the 0.4 era, I only pinged you because I saw someone saying they had it with 1.1.0. I still do leave mine configured with x86 regardless of whether my code is managed or not. If I have time I'll experiment.

[jbrownkramer]

I believe one issue was fixed by changing the platform, but I have not tried to replicate the problem.

One thing I know for sure: I have a project - project A - that uses onnxruntime as a nuget package. I have another project - project B - that references project A. Unless onnxtruntime is explicitly added as a Nuget package to project B, onnxtruntime.dll doesn't get copied into the bin folder. I think this is a property of Nuget more generally, and not onnxruntime per se.

[sacha-c]

It happens to me also on 1.1.1, and without a way to reproduce it for now

[sacha-c]

I figured out my issue!

I am using paket as a package manager, instead of VS nuget manager. So my project doesn't have a packages.config, which is why onnxruntime.dll is never copied

props.xml has the following conditions:
<ItemGroup Condition="Exists('packages.config') OR Exists('$(MSBuildProjectName).packages.config') OR Exists('packages.$(MSBuildProjectName).config')">

I will be creating a new issue for this

[aleksandar-lazic]

I've had this error with Microsoft.ML.OnnxRuntime.Gpu 1.3.0

Turns out, I've accidently removed "NVIDIA GPU Computing Toolkit" from the path.

[Chase-William]

@devnet123 I get the same error on both 1.5.1 and 1.52 versions but I have fixed it.

Here is how I fixed it:
Go to here: download onnxruntime.dll from github
I downloaded the onnxruntime-win-x64-1.5.1.zip package since it matches my OS and architecture.

Then once you have that downloaded, unzip it and go to: *onnxruntime-win-x64-1.5.1\lib*
You should see the onnxruntime.dll inside there.. just leave it for now..
Keep that directory open and then go to back to your project.
Go to the directory (assuming your using .netcore and x64): *bin\x64\Debug\netcoreapp3.1\runtimes\win-x64\native*
What matter is you go to the native folder.
Copy the onnxruntime.dll into that native folder which might have LdaNative.dll and tensorflow.dll also in it (mine does for my setup).
Now when you run your program you should be able to find that dll (module) the application was complaining about.

I hope that fixes your problem!

[Aida-Enna]

Having the same issue using AnyCPU - It doesn't download/install the 32bit DLLs and so the project I'm trying to use it fails with System.BadImageFormatException: 'Could not load file or assembly 'Aspose.OCR, Version=21.1.2.0, Culture=neutral, PublicKeyToken=716fcc553a201e56' or one of its dependencies. An attempt was made to load a program with an incorrect format.' (because it loads the 64 bit DLLs)

I downloaded the x86 release zip and was able to place onnxruntime.dll in the right directory (\packages\Microsoft.ML.OnnxRuntime.MKLML.1.4.0\runtimes\win-x86\native\) to (assumedly, since I can't run it) fix it, but I'm not able to find pre-compiled x86 versions of mklml.dll and libiomp5md.dll to see if this would fix it for them as well.

[mcicat]

I struggled with this until I fired up "Depends" and discovered that it requires the VC runtime.

Thank You for this, You saved me hours.

[lxmou666]

我一直在努力解决这个问题，直到我启动了"Depends"并发现它需要VC运行时。

I solved it in this way,thanks!

[benquan]

I was having same problem with VS2022 and deploying to windows x86.

If I install on develepment computer, it all runs fine, but if it's a clean Win10 computer (recently installed), I will get the error. The error got solved by installing "Visual C++ Redistributable for Visual Studio" as @nelemans1971 suggested. Why is it not included in the nuget dependencies?

[yuGAN6]

Same issue here and solved by installing vc redists.

It seems Microsoft just assume everyone has installed vc redists by default, that's really a pain in the ass. Not only onnxruntime, but a huge amount of software.

If the vc redists are soooo important, why not contain them all in windows? Confusing.