Elements of a Simple NLP System |
27-Aug | Course Overview / Introduction HW1 Out |
29-Aug | Text Classification, Data Basics, Perceptron |
03-Sep | Neural Network Basics |
Language Modeling Fundamentals |
05-Sep | Lexical Semantics, Word Embeddings |
10-Sep | N-gram Language Models HW1 Due HW2 Out |
12-Sep | Tokenization |
17-Sep | Neural Language Models, Attention... |
19-Sep | Transformers |
24-Sep | Pre-training 1: Encoders (BERT) HW2 Due (Feb 10) |
26-Sep | Pre-training 2: BART/T5/GPT, Decoding Methods |
01-Oct | Pre-training 3: Scaling, Prompting, In-Context Learning, Chain-of-Thought |
Learning from Labeled Data |
03-Oct | Alignment I: Instruction Tuning FP Proposals Due HW3 Out |
08-Oct | Alignment II: Reward Modeling / Preference Optimization |
10-Oct | Parameter Efficient Finetuning: (Q)LoRA |
15-Oct | Benchmarking |
17-Oct | Autumn Break |
Linguistic Structure Prediction |
22-Oct | Sequence Tagging HW3 Due |
24-Oct | Parsing |
Modern LMs in Practice |
29-Oct | Interpretability |
31-Oct | Efficiency |
05-Nov | Multimodal LMs |
07-Nov | Multilingual LMs FP Check in Due |
12-Nov | Retrieval |
14-Nov | Agents" |
19-Nov | Multilinguality |
21-Nov | Safety and Ethics |
26-Nov | Thanksgiving Break |
28-Nov | Thanksgiving Break |
03-Dec | TBD |
05-Dec | FP Presentations |
10-Dec | FP Presentations FP Final Reports Due April 25 |