wannaphong / laonlp

Lao language NLP

LaoNLP

Lao language Natural Language Processing (NLP)

Features

• Word tokenizer
• Sentence tokenizer
• Part-of-speech
• Lao to Thai script
• Thai to Lao script
• Word dictionary
• Word Vector

Install

pip install laonlp

Installation Options

Some functionalities, like word vectors, may require extra packages. To install those requirements, specify a set of [name] immediately after laonlp:

pip install laonlp[extra1,extra2,...]

List of possible extras

• full (install everything)
• word_vector (for support of word vector functionalities)

For dependency details, look at extras variable in setup.py.

Documentation: https://github.com/wannaphong/LaoNLP/wiki

Citations

If you use LaoNLP in your project or publication, please cite the library as follows

Wannaphong Phatthiyaphaibun. (2022). LaoNLP: Lao language Natural Language Processing. Zenodo. https://doi.org/10.5281/zenodo.6833407

or BibTeX entry:

@misc{wannaphong_phatthiyaphaibun_2022_6833407,
  author       = {Wannaphong Phatthiyaphaibun},
  title        = {LaoNLP: Lao language Natural Language Processing},
  month        = jul,
  year         = 2022,
  publisher    = {Zenodo},
  doi          = {10.5281/zenodo.6833407},
  url          = {https://doi.org/10.5281/zenodo.6833407}
}

License

   Copyright 2020 - 2024 Wannaphong Phatthiyaphaibun

   Licensed under the Apache License, Version 2.0 (the "License");
   you may not use this file except in compliance with the License.
   You may obtain a copy of the License at

       http://www.apache.org/licenses/LICENSE-2.0

   Unless required by applicable law or agreed to in writing, software
   distributed under the License is distributed on an "AS IS" BASIS,
   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
   See the License for the specific language governing permissions and
   limitations under the License.

laonlp's Issues

Train more Part-of-speech Corpus

I found new Lao Part-of-speech Corpus. I will train model and upload to LaoNLP.

[TODO] Add Lao word embedding

Add Lao word embedding to LaoNLP.

[TODO] Numbers to Lao words

I think LaoNLP should add the numbers to Lao words function. It is TODO.

18f7239#diff-dd49b1c660b278e3757f1d2379478e7647262b8949fa861107dd8efbf1ef2e08R44

[TODO] Lao Romanization

It is work for Lao Romanization.

• Romanization of Lao from Wikipedia
• ROMANIZATION OF LAO B GN/PCGN 1966 Agreement
• https://www.loc.gov/catdir/cpso/romanization/lao.pdf

Part-of-speech for lao

Hello everyone! I want to make the part-of-speech functions to LaoNLP but I don't have any corpus for train.
if you have lao part-of-speech corpus, you can comment in this issue or sent to my email ([email protected]).

Thank you!