Elements of a Simple NLP System |
08-Jan | Course Overview / Introduction HW1 Out |
10-Jan | Text Classification, Data Basics, Perceptron |
15-Jan | Neural Network Basics |
Language Modeling Fundamentals |
17-Jan | Lexical Semantics, Word Embeddings |
22-Jan | N-gram Language Models HW1 Due HW2 Out |
24-Jan | Tokenization |
29-Jan | Neural Language Models, Attention... |
31-Jan | Transformers |
05-Feb | No class |
07-Feb | Pre-training 1: Encoders (BERT) HW2 Due (Feb 10) |
12-Feb | Pre-training 2: BART/T5/GPT, Decoding Methods |
14-Feb | Pre-training 3: Scaling, Prompting, In-Context Learning, Chain-of-Thought |
Learning from Labeled Data |
19-Feb | Alignment I: Instruction Tuning FP Proposals Due HW3 Out |
21-Feb | Alignment II: Reward Modeling / Preference Optimization |
26-Feb | Parameter Efficient Finetuning: (Q)LoRA |
28-Feb | Benchmarking |
Linguistic Structure Prediction |
05-Mar | Sequence Tagging HW3 Due |
07-Mar | Parsing |
12-Mar | NO CLASS |
14-Mar | NO CLASS |
Modern LMs in Practice |
19-Mar | Interpretability |
21-Mar | Efficiency |
26-Mar | Multimodal LMs |
28-Mar | Multilingual LMs FP Check in Due |
02-Apr | Retrieval Augmented LMs |
04-Apr | Agents" |
09-Apr | Safety and Ethics |
11-Apr | FP Presentations |
16-Apr | FP Presentations FP Final Reports Due TBD |