Week 3 - Introduction to Transformer Models

This week you will...

  • learn about the basic structure of the transformer models
  • get to know what tokenization is about and why it is important.

Learning Resources

221109_Introduction to Transformers.pdf
2MB
PDF
  • To get an idea about the number of tokens a text or word is made off in the GPT models, you may want to checkout this site.

Until next week you should...

  • complete chapter 3 (Fine-Tuning a Pretrained Model) of the Hugging Face course.
  • meet with the other participants of the project you are interested in to get a more concrete idea of the project goal.