Comments (3)
I'm not 100% sure what should be put in such a guide, hence its absence for now :)
To me, the best way for people to get involved is to start by using candle and writing the models that they care about - it would be great to see libraries emerge that use candle to build an equivalent to llama.cpp or whisper.cpp (we provide these in the main repo but the goal is not to be feature complete here but rather to show how candle can be used in such cases).
Besides this the model wishlist #1177 is a great place to find models that would be helpful to other people.
One thing that we're lacking at the moment is onboarding material for people writing new models, and this could certainly use some help. The "book" should certainly be revamped, or maybe even rewritten from scratch, and it would be great to have more tutorials and teaching material that describe how to convert some existing pytorch models to candle.
from candle.
A list of starter issues would be good, things that aren't super high priority but would be welcome additions.
from candle.
Perfect, that sounds like a good idea with the book and improving rust docs on the operations as well 👍
from candle.
Related Issues (20)
- Codegemma-7b-instruct failure on Metal HOT 4
- Request: PixelShuffle HOT 1
- Build Failure with candle-kernels: nvidia-smi Not Found in Docker Environment, Even Though It Is Available HOT 6
- Processing text prompts in batches for LLMs HOT 4
- Equivalent of torch.nonzero ? HOT 1
- M2m100 model
- error while loading shared libraries: libnvrtc.so.12 HOT 3
- No compiler check for operation on different tensor type. HOT 1
- Request: Please add support in examples for the new MS/Phi-3 family HOT 2
- Support for Microsoft Phi-3 128k context length HOT 1
- quantized_llama ModelWeights path used in quantized Phi3 HOT 2
- error when import onnx of yolo8
- Phi-3 implementation seems to be buggy on metal devices HOT 5
- `Msg("unknown magic 46554747")` when trying to load tensor from GGUF HOT 2
- A keyboard malfunction created this. HOT 1
- DriverError(CUDA_ERROR_ILLEGAL_ADDRESS, "an illegal memory access was encountered")
- Adding direct-F16 quantization HOT 9
- Candle won't use half-gemm from cublas when doing fp16 matmul HOT 8
- "Illegal Instruction" on Older CPUS HOT 2
- Low time effiency when run cnn on mnist-traning only with CPU HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from candle.