Schedule

DateTopic
Elements of a Simple NLP System
14-Jan Course Overview / Introduction HW1 Out
16-Jan Text Classification, Data Basics, Perceptron
21-Jan Neural Network Basics
Language Modeling Fundamentals
23-Jan Lexical Semantics, Word Embeddings
28-Jan N-gram Language Models HW1 Due HW2 Out
30-Jan Tokenization
4-Feb Neural Language Models, Attention...
6-Feb Transformers
11-Feb Pre-training 1: Encoders (BERT) HW2 Due (TBD)
13-Feb Pre-training 2: BART/T5/GPT, Decoding Methods
18-Feb Pre-training 3: Scaling, Prompting, In-Context Learning, Chain-of-Thought
Learning from Labeled Data
20-Deb Alignment I: Instruction Tuning FP Proposals Due HW3 Out
25-Feb Alignment II: Reward Modeling / Preference Optimization
27-Feb Parameter Efficient Finetuning: (Q)LoRA
4-Mar Benchmarking
6-Mar Sequence Tagging
Linguistic Structure Prediction
11-Mar Parsing HW3 Due
13-Mar Efficiency
Modern LMs in Practice
18-Mar Spring break - No class
20-Mar Spring break - No class
25-Mar Multilingual LMs
27-Mar Interpretability FP Check in Due
1-Apr Retrieval
3-Apr Agents
8-Apr Multimodal LMs
10-Apr Safety and Ethics
15-Apr TBD
17-Apr TBD
22-Apr FP Presentations
24-Apr FP Presentations FP Final Reports Due TBD