Loading...
learn about the basic structure of the transformer models
get to know what tokenization is about and why it is important.
To get an idea about the number of tokens a text or word is made off in the GPT models, you may want to checkout this site.
complete chapter 3 (Fine-Tuning a Pretrained Model) of the Hugging Face course.
meet with the other participants of the project you are interested in to get a more concrete idea of the project goal.