Comments (8)
@Spring1212, the size of vocabulary that you are trying to use is only 26 tokens - not good. Apparently you rewrote the default vocabulary file by running prepare_index_files.py
. See the corresponding section of our Readme for a fix guideline: https://github.com/lukalabs/cakechat#training-the-model-from-scratch
from cakechat.
Is this due to too little training data?
from cakechat.
Can adding training data avoid this problem?
from cakechat.
Is this due to too little training data?
You got a different index files because apparently you run prepare_index_files.py
and it rewrote the original index files. Even if you had training data in abundance, running this script would still result in overwriting index files, so won't be able to use our pretrained model.
If you just want to use our pretrained model without finetuning on you own data, you don't need to run prepare_index_files.py
script. Restore the default index files following the link I send you in the previous message and run the server with our pretrained model after that.
And in case you do want to tune our model or to train your own from scratch, please, read carefully the corresponding sections from our Readme: https://github.com/lukalabs/cakechat#training-the-model
from cakechat.
According to the self-report file training model from scratch, every step of adding training data into the file is operated.
from cakechat.
Is this still a pre-training model?
from cakechat.
Seems like I got the problem: the server is trying to use a reverse model for sampling_reranking
mode of generating answers and, I assume, you didn't train it, since it's not mentioned in this section of our Readme.
Option 1: change sampling_reranking
to sampling
here: https://github.com/lukalabs/cakechat/blob/master/cakechat/api/config.py#L4
Option 2: run python tools/train.py -r
to train the reverse model.
In either case, please, note that you'll need to use a larger training set with larger vocabulary to get any meaningful results after training.
from cakechat.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
from cakechat.
Related Issues (20)
- Using the trained model HOT 5
- How to get only 1 sentence of answer? HOT 3
- Grammatically-correct response HOT 3
- ValueError: numpy.ufunc has the wrong size when launching Docker container HOT 4
- AttributeError: 'module' object has no attribute '_get_ndarray_c_version' HOT 7
- Syntax Error:Invalid Syntax HOT 3
- tools/fetch.py ImportError: DLL load failed: The specified module could not be found. error HOT 12
- tools/fetch.py fails. File can not be downloaded. HOT 2
- Dataset Format HOT 4
- cannot get trained model HOT 1
- Tensorflow GPU issue HOT 7
- Quick start for GPU version: HOT 2
- DialogFlow HOT 3
- Installing on Google Cloud Platform HOT 4
- APK? HOT 6
- Recommended server specs? HOT 2
- How to train data with new condition HOT 2
- add actions when asked something HOT 1
- Gives import error on running fetch.py HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cakechat.