Week 2 - Self-Attention and Prompt Design

This week you will...

• get to know the mechanism underlying the self-attention approach.

• get to know the basics of prompt design and how to apply them in a playground.

• get to know examples for the application of transformer models.

Learning Resources

Additional resource explaining the Transformer model:

• Text: The Illustrated Transformer by Jay Alammar

• Video: Transformer Neural Networks - EXPLAINED!

Until next week you should...

• Watch video 3 (Multi Head Attention) and video 4 (Transformers) of the Rasa Series on Transformers & Attention.

• Note at least one question on the each of the videos!

• Complete chapter 2 of the Hugging Face course.

• Think about the project you want to do and/or get in contact with course mates about it.