Week 1 - General Introduction

This week you will...

• get all details about the structure and form of the course.

• get to know your fellow course participants.

• discuss the general types of training large language models.

• discuss current sources for staying up-to-date.

Learning Resources

6MB

240415_General Introduction.pdf

pdf

• Hugging Face NLP course

• YouTube channel from Yannic Kilcher

Until next week you should...

• decide on a project.

• watch Creating your own ChatGPT: Supervised fine-tuning (SFT) from Niels Rogge (1 hour).

• note at least one question on the video above.

• watch the four videos of the Rasa Algorithm Whiteboard on Transformers and Attention (Part 1 to Part 4; about 50 minutes in total) if the transformers architecture is new to you.