gibranakbaromil / simple_preprocessing

It is a simple preprocessing with python

simple preprocessing

It is a simple preprocessing with python

How to use

1. place it in the same directory
2. import simple preprocessing in your file with

import simple_preprocessing import preprocessing

3. for preproces you can use string and an array

_input = "example"
data_input = preprocessing(_input)

4. the flow of this simple proprocessing is cleaning => tokenization => filtering => stemming => term
5. if you have a stoplist.txt laying around somewhere, you can feed it to filtering, stemming, term or dont :)
6. and if only certain function that you need, just call the function directly, its 0kay
7. Thats it

Note

make sure you install the stemming library first with pip install Sastrawi