kenlm State length mis-match about phrasal

[ttpro1995]

run with java loader, it seem to woking fine

Done loading phrase table: /data/20171214/config/zing.tables/phrase-table.gz (mem used: 71 MiB time: 0.190 s)
Longest foreign phrase: 5
Loading extended Moses Lexical Reordering Table: dev.tables/lo-hier.msd2-bidirectional-fe.gz
Done loading reordering table: dev.tables/lo-hier.msd2-bidirectional-fe.gz (mem used: 71 MiB time: 0.120s)
Hierarchical reordering model:
Distinguish between left and right discontinuous: true
Use containment orientation: false
Forward orientation: hierarchical
Backward orientation: hierarchical
Reading 262144 1-grams...
Reading 8388608 2-grams...
Reading 67108864 3-grams...

[pdhung3012]

Hello. What do you mean java loader. Do you still run the phrasal.sh?

[ttpro1995]

you pick loader in .init
Look at example here
https://github.com/stanfordnlp/phrasal/blob/be69585b62d75d2bf1092bd534a4c5602ea34b63/example/example.ini (line 14-17)

# The 'kenlm:' enables the KenLM loader. Remove the
# prefix for the standard Java ARPA loader.
[lmodel-file]
kenlm:/home/me/phrasal.fr-en/4gm.bin

So, if you want java loader, remove the "kenlm"