Comments (5)
jdchoi77
commented on August 20, 2024
Could you be more specific? What do you mean by "adding some more places" to which model? Thanks.
from nlp4j-old.
ShafeenaBasheer
commented on August 20, 2024
Hi,
We need to add more locations(GPE) to NER model.
We tried following as the training data .but it is not working.
1 Peruvanthanam peruvanthanam NNP pos2=NN 0 root _ U-GPE.
Please help.
Thanks in advance.
from nlp4j-old.
jdchoi77
commented on August 20, 2024
It's hard to tell what's not working when there is no explicit error sign I can take a look. Your training data should consist of sentences annotated with named entities (instead of individual tokens). Training a completely new model using your data should be relatively easy (please see https://github.com/emorynlp/nlp4j/blob/master/md/quickstart/train.md). Augmenting the pre-trained model is trickier but can be done by using the -p option.
from nlp4j-old.
ShafeenaBasheer
commented on August 20, 2024
Hi,
We tried to augment the pre-trained model of NER by using following training files(attached )
TrainSample.zip
and run configurations
-c config-train-ner.xml -t sample-trn.tsv -d sample-dev.tsv -p en-ner-old.xz -m en-ner.xz -mode ner
but we are getting following error**
_2016-06-15 21:08:12 INFO BinUtils:220 - AdaGrad Mini-batch
- Max epoch: 20
- Mini-batch: 5
- Learning rate: 0.02
- LOLS: fixed = 0, decaying rate = 0.95
- RDA: 1.0E-5
2016-06-15 21:08:12 INFO BinUtils:221 - Training: 0
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescent.expand(AdaptiveGradientDescent.java:47)
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.expand(AdaptiveGradientDescentMiniBatch.java:55)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.expand(OnlineOptimizer.java:215)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:173)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:12 INFO BinUtils:240 - 0: 1: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244230, NZW = 1928092, N/S = 51
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescent.expand(AdaptiveGradientDescent.java:47)
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.expand(AdaptiveGradientDescentMiniBatch.java:55)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.expand(OnlineOptimizer.java:215)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:173)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:12 INFO BinUtils:240 - 0: 2: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244240, NZW = 1928092, N/S = 3000
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescent.expand(AdaptiveGradientDescent.java:47)
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.expand(AdaptiveGradientDescentMiniBatch.java:55)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.expand(OnlineOptimizer.java:215)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:173)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescent.expand(AdaptiveGradientDescent.java:47)
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.expand(AdaptiveGradientDescentMiniBatch.java:55)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.expand(OnlineOptimizer.java:215)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:173)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:12 INFO BinUtils:240 - 0: 3: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244244, NZW = 1928092, N/S = 3000
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescent.expand(AdaptiveGradientDescent.java:47)
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.expand(AdaptiveGradientDescentMiniBatch.java:55)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.expand(OnlineOptimizer.java:215)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:173)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:12 INFO BinUtils:240 - 0: 4: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244248, NZW = 1928092, N/S = 3000
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescent.expand(AdaptiveGradientDescent.java:47)
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.expand(AdaptiveGradientDescentMiniBatch.java:55)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.expand(OnlineOptimizer.java:215)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:173)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:12 INFO BinUtils:240 - 0: 5: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244253, NZW = 1928092, N/S = 6000
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:12 INFO BinUtils:240 - 0: 6: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = 6000
2016-06-15 21:08:12 INFO BinUtils:240 - 0: 7: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = 6000
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:12 INFO BinUtils:240 - 0: 8: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = 6000
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:12 INFO BinUtils:240 - 0: 9: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = 6000
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:12 INFO BinUtils:240 - 0: 10: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = 6000
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:13 INFO BinUtils:240 - 0: 11: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = 6000
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:13 INFO BinUtils:240 - 0: 12: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = 6000
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:13 INFO BinUtils:240 - 0: 13: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = 6000
2016-06-15 21:08:13 INFO BinUtils:240 - 0: 14: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = -1
2016-06-15 21:08:13 INFO BinUtils:240 - 0: 15: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = 6000
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:13 INFO BinUtils:240 - 0: 16: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = 6000
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:13 INFO BinUtils:240 - 0: 17: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = -1
2016-06-15 21:08:13 INFO BinUtils:240 - 0: 18: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = -1
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:13 INFO BinUtils:240 - 0: 19: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = -1
java.lang.NullPointerException
at edu.emory.mathcs.nlp.learning.optimization.AdaptiveGradientDescentMiniBatch.updateWeight(AdaptiveGradientDescentMiniBatch.java:63)
at edu.emory.mathcs.nlp.learning.optimization.StochasticGradientDescent.trainClassification(StochasticGradientDescent.java:50)
at edu.emory.mathcs.nlp.learning.optimization.method.AdaGradMiniBatch.trainAux(AdaGradMiniBatch.java:44)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:178)
at edu.emory.mathcs.nlp.learning.optimization.OnlineOptimizer.train(OnlineOptimizer.java:167)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:201)
at edu.emory.mathcs.nlp.component.template.OnlineComponent.process(OnlineComponent.java:173)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.iterate(OnlineTrainer.java:299)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:229)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:200)
at edu.emory.mathcs.nlp.component.template.train.OnlineTrainer.train(OnlineTrainer.java:187)
at edu.emory.mathcs.nlp.bin.NLPTrain.train(NLPTrain.java:77)
at edu.emory.mathcs.nlp.bin.NLPTrain.main(NLPTrain.java:117)
2016-06-15 21:08:13 INFO BinUtils:240 - 0: 20: F1: 0.00, P: 0.00, R: 0.00, L = 73, SF = 244259, NZW = 1928092, N/S = -1_
from nlp4j-old.
jdchoi77
commented on August 20, 2024
Sorry about this; it just reminded me that the current models I released do not support this feature any more to reduce the model size. A separate module is needed to make the online learning work now :( I'll try to add this feature in the next release. Sorry again.
from nlp4j-old.
Related Issues (20)
- Part-of-Speech Tagging example HOT 1
- only POS tagger HOT 4
- ArrayIndexOutOfBoundException in NER Training HOT 4
- StringIndexOutOfBoundsException HOT 1
- How do you use the POS tagger? HOT 2
- Are components reentrant? Can components be cloned? HOT 2
- Does the dependency parser 'depend' on the named entity tagger? HOT 1
- Garbage tokens? HOT 2
- Dep parser appears to produce multiple nodes with the head of the tree as the root. HOT 1
- Universal Dependencies HOT 10
- CLI for Eval? HOT 2
- Infinite recursion in AbstractNLPDecoder.createTSVReader() HOT 2
- slf4j would be more flexible than raw log4j HOT 6
- Two root nodes from one sentence to the DP, any advice? HOT 5
- POS tagger model takes time to load HOT 2
- Exception reading dependency model HOT 1
- How to speed up the dependency parser by reworking one method HOT 2
- tsv option not working HOT 1
- Nlp Training for NER HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nlp4j-old.