Comments (4)
Currently, we can only do PyTorch Traced model. There are a few examples that may allow us import in DJL:
thirdparty popular BERT pretrained model
If you are interested, please feel free to search for a BERT pretrained model. You can tested it out using DJL with Jupyter Notebook and help us grow the model zoo! :)
from djl.
Hey @HerbJiang,
I have uploaded the HuggingFace Bert Question Answering Model. You can try it out with
git clone https://github.com/awslabs/djl.git
cd djl
./gradlew :examples:run -Dmain=ai.djl.examples.inference.BertQaInference -Dai.djl.default_engine=PyTorch
The source code is here and translator implementation.
I am working on the jupyter notebook, stay tuned
from djl.
@HerbJiang
I completed the pytorch BERT QA jupyter notebook.
You can use it with your pretrained BERT along with vocabulary from HuggingFace.
Remember to convert your model to TorchScript.
If you need any help, please let us know.
from djl.
feel free to open the issue, if you have any question
from djl.
Related Issues (20)
- Could not find artifact ai.djl.pytorch:pytorch-native-cu118:jar:linux-x86_64:2.1.1 HOT 2
- DJL bench on GPU fails using PyTorch Engine HOT 5
- RuntimeError: The size of tensor a (16) must match the size of tensor b (80) at non-singleton dimension 3 HOT 1
- Hundreds wrong detection on yolov8 HOT 14
- SIGSEGV faults
- When I build a project supporting DJL in Android Studio, I encounter the following error. How can I resolve it? HOT 3
- Cannot use trained gluonTS model
- Adding ppc64le support for PyTorch engine HOT 4
- Please report location when HuggingFaceTokenizer.newInstance fails with I/O error HOT 11
- How to support paddlepaddle on an aarch64 FT Phytium S2500/64 machine?
- Run tensorflow model on arm architecture HOT 2
- Could not initialize class ai.djl.onnxruntime.engine.0rtNDManager HOT 4
- NDArrays.concat has a different behaviour as np.concatenate HOT 4
- Potential Race Condition or Garbage Collection Issue during JNI Environment Usage HOT 1
- NumberFormatException: Cannot parse null string when loading inside of Docker HOT 1
- Extracting local model ZIP multiple times HOT 3
- Error encountered when predicting with xgboost on Linux arm64 HOT 2
- SIGSEGV calling NDList.encode() HOT 3
- OnnxRuntime 引擎官网案例报错 HOT 9
- Missing Features Exception while inputting the custom dataset.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from djl.