Repository created to hold code developed at the Computational Linguistics Lecture at the Universität des Saarlandes
Empirical verification of Zipf's law along three different Corpora:
- King James Bible
- The Jungle Book
- SETIMES Turkish-Bulgarian Parallel Newspaper Text
Reimplementation of the Dissociated Press. N-gram generation from a probability distribution
The PMI(Pointwise Mutual Information) Score tests the independence assumption of many phenomena that is modeled as independent when they, in reality, are not independent.
Markov chain
CKY Parser
Part of Speech Tagger using PyTorch
Word Alignments
Latent Dirichlet Allocation with Numpy
LDA Performance on Grouping Diachronic Data