Schedule

DateTopic
Elements of a Simple NLP System
08-Jan Course Overview / Introduction HW1 Out
10-Jan Text Classification, Data Basics, Perceptron
15-Jan Neural Network Basics
Language Modeling Fundamentals
17-Jan Lexical Semantics, Word Embeddings
22-Jan N-gram Language Models HW1 Due HW2 Out
24-Jan Tokenization
29-Jan Neural Language Models, Attention...
31-Jan Transformers
05-Feb No class
07-Feb Pre-training 1: Encoders (BERT) HW2 Due (Feb 10)
12-Feb Pre-training 2: BART/T5/GPT, Decoding Methods
14-Feb Pre-training 3: Scaling, Prompting, In-Context Learning, Chain-of-Thought
Learning from Labeled Data
19-Feb Alignment I: Instruction Tuning FP Proposals Due HW3 Out
21-Feb Alignment II: Reward Modeling / Preference Optimization
26-Feb Parameter Efficient Finetuning: (Q)LoRA
28-Feb Benchmarking
Linguistic Structure Prediction
05-Mar Sequence Tagging HW3 Due
07-Mar Parsing
12-Mar NO CLASS
14-Mar NO CLASS
Modern LMs in Practice
19-Mar Interpretability
21-Mar Efficiency
26-Mar Multimodal LMs
28-Mar Multilingual LMs FP Check in Due
02-Apr Retrieval
04-Apr Agents"
09-Apr Multilinguality
11-Apr Safety and Ethics
16-Apr FP Presentations
18-Apr FP Presentations FP Final Reports Due April 25