Lista de secções

◄Exercises
►Exams

  • This is planned/tentative content. As such it is still subject to change, that is, modifications both with respect to the topics and order of lectures are possible. 

    DateLectureBlocks
    26.4.L1: Languages of the world & Linguistic Universals; Course organizationIntroduction
    10.5.L2: Language modeling, word embedding models, vocabulary & tokenizationBlock I: Fundamentals
    17.5.L3: Training Deep LMs — Gradient Descent, Backprop, Batching, Dropout… Block I: Fundamentals
    24.5.L4: Transformer Almighty & Pretraining Language Models Block I: Fundamentals
    31.5.L5: Multilingual Word Embedding SpacesBlock II: Multilinguality
    7.6.L6: Multilingual LMs and CL Transfer, Multilingual EvaluationBlock II: Multilinguality
    14.6.L7: Curse of Multilinguality, Modularization, and Language AdaptationBlock II: Multilinguality
    28.6.L8: Transfer for Token-Level Tasks: Word Alignment & Label ProjectionBlock II: Multilinguality
    5.7.L9: Neural Machine TranslationBlock III: Advanced
    12.7.L10: Multilingual Sentence Representations Block III: Advanced
    19.7.L11: Prompting and LLMs; ChatGPT/GPT-4Block III: Advanced


◄Exercises
►Exams