xquanl / mids_nlp_22fall

All projects and learning resources during MIDS

FALL_2022_NLP

This repository contains assignments and slides for IDS703 Natural Language Processing at Duke.

In the NLP_hw directory, there are 8 personal assignments.

1. Regular Expression
   • Write a regular expression that matches people’s full names
   • Develop a regular expression that matches all gerunds within a text
2. Spelling Correction
   • Build a spelling corrector based on the Levenshtein distance
3. N Gram Model
   • Write a bare-bones Markov text generator
4. POS Tagging
   • Use the first 10k tagged sentences from the Brown corpus to generate the components of a part-of-speech hidden markov model
5. Document Vectors
   • Explore how term-document matrices and weightings can be used for docu- ment classification, including raw counts of terms, TF-IDF, TF-IDF variant
6. RNN
   • Construct, manually, a RNN structure and associated weights
7. BRNN
   • Construct, manually, a bidirectional RNN structure and associated weights
8. NN Design
   • Design a neural network that segments an English word into prefixes, root, and suffixes using a BIO labelling scheme.