Comments (4)
@Sankalp1233 You can procede in two ways
- Using a pre-trained QA model: Place your document and the question into the squad dataset format and then feed it into the model to get the answer.
1.2) To obtain the answer predicted I suggest the reading of this tutorial based on huggingface api. - Train your own QA model: In the same way you have to produce a dataset with the triple (context, question, answer).
2.2) Use this tutorial for training
I am not a huggingface employee I hope I helped you. They are certainly more experienced than me.
from notebooks.
For the tutorial for training I am not getting the code come up. It says Sorry, something went wrong. Reload? and for the other tutorial:https://towardsdatascience.com/simple-and-fast-question-answering-system-using-huggingface-distilbert-single-batch-inference-bcf5a5749571. I have this coming up: How to read this story from Ramsri Goutham — and everything else on Medium.
You’ve read all your free member-only stories. Become a member to get unlimited access and support the voices you want to hear more from.
Upgrade
Read any story. Access everything on Medium across all your devices with no limits or ads.
Reward great writing. A portion of your membership fee will go toward the writers you read most. Can you please try to screenshot the code so I could see it better?
from notebooks.
Hi @Sankalp1233,
about the tutorial on point (2) is a well-know issue of github.com, so you have to download the jupyter notebook file or clicking here to open it in colab.
Regarding to the towardsdatascience.com try to sign up to medium or opening it via incognito mode in your browser.
from notebooks.
I did open it incognito mode, but I need the part of the article where it states Here is the code to make a single inference with DistilBERT. If you have the code, can you please kindly share it? Does distilbert have the same problem as bert, where it only takes 512 tokens at once?
from notebooks.
Related Issues (20)
- training, deploying sentence transformer model ( setfit method) in sagemaker pipeline HOT 2
- SAM iou_score is greater than 1?
- Incomplete Output from IDEFICS Inference Code HOT 1
- AttributeError: 'NoneType' object has no attribute 'get' while training HOT 2
- Pandas is required for the TAPAS tokenizer
- Separate model and inference script tar.gz not working.
- instruction finetuning IDEFICS
- Fine_tune_BLIP2_on_an_image_captioning_dataset_PEFT.ipynb loss is all NaN HOT 25
- Training SegFormer model not working (goes through notebook, but model loss becomes nan) on dataset I created (stuck for a week or so) HOT 5
- Informer/Transformer: multivariate forecasting with a panel of time-series
- Broken link in sagemaker notebook HOT 2
- SDXL_Dreambooth_LoRA_advanced_example.ipynb Training Issue
- FSDP training not loading saving the best checkpoint
- PatchTSTMixer fix HOT 4
- (TF)DistilBertForTokenClassification requires the 🤗 Datasets library
- Broken link in Load LoRAs for inference HOT 1
- RuntimeError expected scalar type Long but found Int in audio_classification.ipynb
- Incorrect variable name `tokenized_dataset` in Chapter 7 section 6 of course HOT 1
- 4 files in transformers_doc/en/ directory are newer than the ones in transformers_doc and should be identical. HOT 1
- Broken link for diffusers/loading_adapters
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from notebooks.