ryanboyd / mehv2 Goto Github PK

It's been a few years, so I genuinely don't remember the rationale behind the ordering on this one. In an old (much older!) version of the software, I had included an option that let users determine which order they wanted the processes to go in (i.e., lemmatizer then stop list, or vice-versa). Somewhere along the way, I decided that this wasn't useful in 99% of situations.

Somewhere along the way, what this means is that everything works fine except for when you are using the lookup lemmatizer. In this case, lemmatization happens after the stop list has been processed, which means that the stoplist misses a ton of stuff. Basically, I need to patch in an extra step where the lookup lemmatizer skips over anything in the stop list.