Schedule

DateTopic
Elements of a Simple NLP System
08-Jan Course Overview / Introduction HW1 Out
10-Jan Text Classification, Data Basics, Perceptron
15-Jan Neural Network Basics
Language Modeling Fundamentals
17-Jan Lexical Semantics, Word Embeddings
22-Jan N-gram Language Models HW1 Due HW2 Out
24-Jan Tokenization
29-Jan Neural Language Models, Attention...
31-Jan Transformers
05-Feb No class
07-Feb Pre-training 1: Encoders (BERT) HW2 Due (Feb 10)
12-Feb Pre-training 2: BART/T5/GPT, Decoding Methods
14-Feb Pre-training 3: Scaling, Prompting, In-Context Learning, Chain-of-Thought
Learning from Labeled Data
19-Feb Alignment I: Instruction Tuning FP Proposals Due HW3 Out
21-Feb Alignment II: Reward Modeling / Preference Optimization
26-Feb Parameter Efficient Finetuning: (Q)LoRA
28-Feb Benchmarking
Linguistic Structure Prediction
05-Mar Sequence Tagging HW3 Due
07-Mar Parsing
12-Mar NO CLASS
14-Mar NO CLASS
Modern LMs in Practice
19-Mar Interpretability
21-Mar Efficiency
26-Mar Multimodal LMs
28-Mar Multilingual LMs FP Check in Due
02-Apr Retrieval Augmented LMs
04-Apr Agents"
09-Apr Safety and Ethics
11-Apr FP Presentations
16-Apr FP Presentations FP Final Reports Due TBD