Week 2 - Self-Attention and Prompt Design

This week you will...

• get to know the mechanism underlying the self-attention approach.

• get to know the basics of prompt design and how to apply them in a playground.

• get to know examples for the application of transformer models.

Learning Resources

Additional resource explaining the Transformer model:

• Text: by Jay Alammar

• Video:

Until next week you should...

• Watch (Multi Head Attention) and (Transformers) of the Rasa Series on Transformers & Attention.

• Note at least one question on the each of the videos!

• Complete of the Hugging Face course.