Comments (4)
I've tried to get build to work on Linux, but then had a problem of how to cleanly install Ninja and Vcpkg.
So I figured out I'll get more quickly to results with https://github.com/sandrohanea/whisper.net
It has an option to provide my own build of libwhisper.so when loading the library, which fits my purpose.
Otoh, I appreciate the cleanliness of your approach: a c++ like interface with least added ceremony (I could simply read the original c++ source files and know how to use the dotnet version).
from whisper.
Yes, something like #20.
Right now I'm stuck on
nvcc fatal : A single input file is required for a non-link phase when an outputfile is specified
C:\Program Files\Microsoft Visual Studio\2022\Enterprise\MSBuild\Microsoft\VC\v170\BuildCustomizations\CUDA 12.1.targets(799,9): error MSB3721: The command ""C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.1\bin\nvcc.exe" --use-local-env -ccbin "C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.35.32215\bin\HostX64\x64" -x cu -ID:\a\whisper\whisper\ext\whisper.cpp. -I"C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.1\include" -I"C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.1\include" --keep-dir x64\Release -maxrregcount=0 --machine 64 --compile -cudart static /Zi -std=c++14 -Xcompiler="/EHsc -Ob2" -D_WINDOWS -DNDEBUG -D_CRT_SECURE_NO_WARNINGS -DGGML_USE_CUBLAS -D"CMAKE_INTDIR="Release"" -D_MBCS -DWIN32 -D_WINDOWS -DNDEBUG -D_CRT_SECURE_NO_WARNINGS -DGGML_USE_CUBLAS -D"CMAKE_INTDIR="Release"" -Xcompiler "/EHsc /W1 /nologo /O2 /FS /MD " -Xcompiler "/FdD:\a\whisper\whisper\out\x64-windows\ext\whisper.cpp\Release\whisper.pdb" -o whisper.dir\Release\ggml-cuda.obj "D:\a\whisper\whisper\ext\whisper.cpp\ggml-cuda.cu"" exited with code 1. [D:\a\whisper\whisper\out\x64-windows\ext\whisper.cpp\whisper.vcxproj]
https://github.com/NickDarvey/whisper/actions/runs/5171997631/jobs/9315926479#step:6:252
It's the same issue that's described in ggerganov/whisper.cpp#840 but I already have the fix described as the submodule is at a later commit than ggerganov/whisper.cpp#867 🫤
It sounds like something in that nvcc.exe
command is misformatted.
I don't have a device to test this on so I'm stuck with a 20 minute or more feedback cycle with GitHub actions. If you have a moment and have a device to test with, it would be helpful if you could try to identify what's wrong with that comand.
from whisper.
Sorry, I wasn't aware this library is Windows only.
The machine with GPU that I intend to run Whisper on is Linux.
I found out only after trying to build this library on Linux.
from whisper.
It's something I'd like to add, #6
You could:
- Add support for it, starting here
- Use https://github.com/sandrohanea/whisper.net which already supports linux
(You'll need to contribute cuBLAS support there, probably publishing another runtime package like is done for CoreML.)
from whisper.
Related Issues (6)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from whisper.