Last updated 2 years ago
learn how to fine-tune a Hugging Face model with your own data
complete chapter 4 (Sharing Models and Tokenizers) and chapter 5 (The Datasets Library) of the Hugging Face course
do a literature review on the task of you project:
Search for transformer models applied to similar problems
Focus on the structure of the input and of the output
Are there pretrained models that you can use?
Which type of model is best suited? Do you need tokenization?
Do you need a type of embedding layer?
