Week 2 - Self-Attention and Prompt Design

This week you will...

  • get to know the mechanism underlying the self-attention approach.
  • get to know the basics of prompt design and how to apply them in a playground.
  • get to know examples for the application of transformer models.

Learning Resources

221102_Self-Attention and Prompt Design.pdf
5MB
PDF
Additional resource explaining the Transformer model:

Until next week you should...

  • Watch video 3 (Multi Head Attention) and video 4 (Transformers) of the Rasa Series on Transformers & Attention.
  • Note at least one question on the each of the videos!
  • Complete chapter 2 of the Hugging Face course.
  • Think about the project you want to do and/or get in contact with course mates about it.