Schedule

DateTopic
Elements of a Simple NLP System
27-Aug Course Overview / Introduction HW1 Out
29-Aug Text Classification, Data Basics, Perceptron
03-Sep Neural Network Basics
Language Modeling Fundamentals
05-Sep Lexical Semantics, Word Embeddings
10-Sep N-gram Language Models HW1 Due HW2 Out
12-Sep Tokenization
17-Sep Neural Language Models, Attention...
19-Sep Transformers
24-Sep Pre-training 1: Encoders (BERT) HW2 Due (Feb 10)
26-Sep Pre-training 2: BART/T5/GPT, Decoding Methods
01-Oct Pre-training 3: Scaling, Prompting, In-Context Learning, Chain-of-Thought
Learning from Labeled Data
03-Oct Alignment I: Instruction Tuning FP Proposals Due HW3 Out
08-Oct Alignment II: Reward Modeling / Preference Optimization
10-Oct Parameter Efficient Finetuning: (Q)LoRA
15-Oct Benchmarking
17-Oct Autumn Break
Linguistic Structure Prediction
22-Oct Sequence Tagging HW3 Due
24-Oct Parsing
Modern LMs in Practice
29-Oct Interpretability
31-Oct Efficiency
05-Nov Multimodal LMs
07-Nov Multilingual LMs FP Check in Due
12-Nov Retrieval
14-Nov Agents"
19-Nov Multilinguality
21-Nov Safety and Ethics
26-Nov Thanksgiving Break
28-Nov Thanksgiving Break
03-Dec TBD
05-Dec FP Presentations
10-Dec FP Presentations FP Final Reports Due April 25