Comments (3)
I changed line 138 of word_tagger_dataset.py (if len(word) < 3; continue to if len(word)< 1, continue), when tring to train in the resulted dataset I got the error below
(it is possible to train with the < 2 constraint)
Traceback (most recent call last):
File "hunvec/seqtag/trainer.py", line 123, in
main()
File "hunvec/seqtag/trainer.py", line 119, in main
wt.train()
File "/home/pajkossy/Proj/hunvec/hunvec/seqtag/sequence_tagger.py", line 242, in train
self.algorithm.train(dataset=self.dataset['train'])
File "/home/pajkossy/pylearn2/pylearn2/training_algorithms/sgd.py", line 455, in train
self.sgd_update(*batch)
File "/home/pajkossy/hunvec_env/local/lib/python2.7/site-packages/theano/compile/function_module.py", line 606, in call
storage_map=self.fn.storage_map)
File "/home/pajkossy/hunvec_env/local/lib/python2.7/site-packages/theano/compile/function_module.py", line 595, in call
outputs = self.fn()
File "/home/pajkossy/hunvec_env/local/lib/python2.7/site-packages/theano/scan_module/scan_op.py", line 672, in rval
r = p(n, [x[0] for x in i], o)
File "/home/pajkossy/hunvec_env/local/lib/python2.7/site-packages/theano/scan_module/scan_op.py", line 661, in
self, node)
File "scan_perform.pyx", line 207, in theano.scan_module.scan_perform.perform (/home/pajkossy/.theano/compiledir_Linux-3.16--amd64-x86_64-with-debian-8.2--2.7.9-64/scan_perform/mod.cpp:2172)
NotImplementedError: We didn't implemented yet the case where scan do 0 iteration
Apply node that caused the error: forall_inplace,gpu,scan_fn}(Elemwise{Composite{minimum(maximum(((i0 + i1) - i1), (i2 - i1)), i3)}}.0, GpuSubtensor{int64:int64:int64}.0, GpuIncSubtensor{InplaceSet;:int64:}.0, GpuDimShuffle{1,0}.0)
Inputs types: [TensorType(int64, scalar), CudaNdarrayType(float32, matrix), CudaNdarrayType(float32, matrix), CudaNdarrayType(float32, matrix)]
Inputs shapes: [(), (0, 17), (2, 17), (17, 17)]
Inputs strides: [(), (17, 1), (17, 1), (1, 17)]
Inputs values: [array(0), <CudaNdarray object at 0x7f9a661fb270>, 'not shown', 'not shown']
HINT: Re-running with most Theano optimization disabled could give you a back-trace of when this node was created. This can be done with by setting the Theano flag 'optimizer=fast_compile'. If that does not work, Theano optimizations can be disabled with 'optimizer=None'.
HINT: Use the Theano flag 'exception_verbosity=high' for a debugprint and storage map footprint of this apply node.
from hunvec.
I think Theano/Theano#3276 will solve the issue, so only an update of theano is needed, but still testing...
from hunvec.
solved in #102
from hunvec.
Related Issues (20)
- feature embedding of low dimension HOT 1
- better log-sum-exp approximation HOT 4
- symmetric window with lookahead HOT 1
- eval, tagging slow HOT 1
- lr_lin_decay HOT 1
- dropout not working when model is reloaded and training is continued HOT 2
- tagger.py bug HOT 2
- embedding init of word vectors, where the word is not in dataset HOT 2
- TaggedCorpus refactoring HOT 2
- decoding HOT 1
- ProjectionLayer fix parameters HOT 1
- complete vocab file needed HOT 1
- words in training, but not in vocab HOT 1
- unknown word's vector HOT 1
- learning_rate_adjustor cannot be omitted HOT 1
- runs 31 epochs instead of 30 HOT 1
- fake_feats error
- prepare.py options HOT 1
- 1 lenght sentences cannot be added to dataset
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hunvec.