SS25: Multilingual Natural Language Processing
You are currently viewing this course as Guest.
Perfilado de sección
-
The first lecture/kick-off session for the course in SS25 will take place on
Wednesday, 23.4.2025 at 10.15
in
Seminarraum 2 (SE2), ground floor of the CAIDAS building (Emil-Fischer-Str. 50)
All further details about the course will be provided in this kick-off lecture.
-
Block 1: Fundamentals
April 23
L1: Languages of the world & Linguistic Universals; Course organization
April 30 L2: Language modeling, word embedding models, tokenization & vocab building May 7 L3: Deep Learning for (Modern) NLP — Perceptron/MLP, Backprop, Batching, Gradient Descent, Dropout… Ex1: Intro to Language Modeling & Tokenization May 14 (online) L4: Transformer Almighty & Pretraining Language Models (autoregressive, masked language modeling) Ex2: Backprop & Training Models in Pytorch Block 2: Multilinguality
May 28
L5: Multilingual Word Embedding Spaces (and CL Transfer with them)
Ex3: Transformer
June 4 L6: Multilingual LMs and Cross-Lingual Transfer; Tasks, Benchmarks & Evaluation Ex4: Project Topics & Setup June 11 L7: Curse of Multilinguality, Modularization, and Language Adaptation June 18 L8: Transfer for Token-Level Tasks: Word Alignment & Label Projection (+ maybe translate train on sequence labeling task) Ex5: Modularization Block 3: Advanced Topics
June 25
L9: Neural Machine Translation (incl. decoder only MT)
Ex6: Transfer for Token-Level Tasks
July 2 L10: Multilingual Sentence Representations Ex7: Neural Machine Translation July 9 L11: Large Language Models, Instruction-Tuning and Generative NLP Ex8: Multilingual Sentence Representations July 23 Student Project Presentations -
-