GithubHelp home page GithubHelp logo

sz128 / slot_filling_and_intent_detection_of_slu Goto Github PK

View Code? Open in Web Editor NEW
388.0 18.0 104.0 9.48 MB

slot filling, intent detection, joint training, ATIS & SNIPS datasets, the Facebook’s multilingual dataset, MIT corpus, E-commerce Shopping Assistant (ECSA) dataset, CoNLL2003 NER, ELMo, BERT, XLNet

License: Apache License 2.0

Python 84.36% Shell 15.64%
crf sequence-labeling encoder-decoder spoken-language bert-bilstm-crf xlnet atis-dataset snips-dataset slot-filling intent-detection

slot_filling_and_intent_detection_of_slu's People

Contributors

sz128 avatar vzxxbacq avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

slot_filling_and_intent_detection_of_slu's Issues

Joint Bert模型复现结果和Slot Filling F1值计算方式

您好,我想问一下Results部分是复现的结果吗?我发现表格中的结果与原论文中的结果好像是一样的,所以有些疑惑。具体地,我比较关注Joint Bert模型,请问您的实现中,槽位F1值的计算方式是什么样的(我不太熟悉Pytorch,您的代码我刚刚看,希望能得到您的解答)?

The difference between Tutorials A "use word embeddings in the pretrained bert model" and Tutorials C "bert+lstm/blstm-crf/enc-dec focus model models"

Hello, your work is very excellent. However, due to my poor understanding, I have some questions when reading the code, and would like to ask for for your help. That is, BERT is used in Tutorial A to obtain word embedding, while BERT+ BLSTM model in Tutorial C is also used to obtain word embedding. What is the difference between the two? And if I want to use bert to get word embeddings and use blstm as the basic model, should I use tutorial A or tutorial C? I will be very happy if you can reply me.

Inference Mode

Hello. After training the model, how can I deploy it and use it in inference mode??

error Connection broken when running python3 scripts/get_ELMo_word_embedding_for_a_dataset.py

I run the command:
python3 scripts/get_ELMo_word_embedding_for_a_dataset.py \

--in_files data/atis-2/{train,valid,test}
--output_word2vec local/word_embeddings/elmo_1024_cased_for_atis.txt

2%|████▍ | 8773632/374434792 [01:56<1:33:25, 65227.37B/s]

Traceback (most recent call last):
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/urllib3/contrib/pyopenssl.py", line 294, in recv_into
return self.connection.recv_into(*args, **kwargs)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/OpenSSL/SSL.py", line 1822, in recv_into
self._raise_ssl_error(self._ssl, result)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/OpenSSL/SSL.py", line 1639, in _raise_ssl_error
raise SysCallError(errno, errorcode.get(errno))
OpenSSL.SSL.SysCallError: (104, 'ECONNRESET')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/urllib3/response.py", line 360, in _error_catcher
yield
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/urllib3/response.py", line 442, in read
data = self._fp.read(amt)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/http/client.py", line 449, in read
n = self.readinto(b)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/http/client.py", line 493, in readinto
n = self.fp.readinto(b)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/socket.py", line 586, in readinto
return self._sock.recv_into(b)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/urllib3/contrib/pyopenssl.py", line 299, in recv_into
raise SocketError(str(e))
OSError: (104, 'ECONNRESET')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/requests/models.py", line 750, in generate
for chunk in self.raw.stream(chunk_size, decode_content=True):
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/urllib3/response.py", line 494, in stream
data = self.read(amt=amt, decode_content=decode_content)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/urllib3/response.py", line 459, in read
raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/contextlib.py", line 99, in exit
self.gen.throw(type, value, traceback)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/urllib3/response.py", line 378, in _error_catcher
raise ProtocolError('Connection broken: %r' % e, e)
urllib3.exceptions.ProtocolError: ('Connection broken: OSError("(104, 'ECONNRESET')",)', OSError("(104, 'ECONNRESET')",))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "scripts/get_ELMo_word_embedding_for_a_dataset.py", line 97, in
to_get_elmo_embeddings = elmo_embeddings(options_file, weight_file)
File "scripts/get_ELMo_word_embedding_for_a_dataset.py", line 22, in init
vocab_to_cache=None)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/allennlp/modules/elmo.py", line 524, in init
self._token_embedder = _ElmoCharacterEncoder(options_file, weight_file, requires_grad=requires_grad)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/allennlp/modules/elmo.py", line 310, in init
self._load_weights()
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/allennlp/modules/elmo.py", line 398, in _load_weights
self._load_char_embedding()
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/allennlp/modules/elmo.py", line 404, in _load_char_embedding
with h5py.File(cached_path(self._weight_file), 'r') as fin:
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/allennlp/common/file_utils.py", line 98, in cached_path
return get_from_cache(url_or_filename, cache_dir)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/allennlp/common/file_utils.py", line 217, in get_from_cache
http_get(url, temp_file)
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/allennlp/common/file_utils.py", line 174, in http_get
for chunk in req.iter_content(chunk_size=1024):
File "/opt/anaconda2/envs/tensorflow36_wb/lib/python3.6/site-packages/requests/models.py", line 753, in generate
raise ChunkedEncodingError(e)
requests.exceptions.ChunkedEncodingError: ('Connection broken: OSError("(104, 'ECONNRESET')",)', OSError("(104, 'ECONNRESET')",))
2%|████▍

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.