It is a simple preprocessing with python
- place it in the same directory
- import simple preprocessing in your file with
import simple_preprocessing import preprocessing
- for preproces you can use string and an array
_input = "example"
data_input = preprocessing(_input)
- the flow of this simple proprocessing is
cleaning => tokenization => filtering => stemming => term
- if you have a stoplist.txt laying around somewhere, you can feed it to
filtering, stemming, term
or dont :) - and if only certain function that you need, just call the function directly, its 0kay
- Thats it
make sure you install the stemming library first with pip install Sastrawi