Week 4 - Fine-Tuning Pretrained Models

This week you will...

  • learn how to fine-tune a Hugging Face model with your own data

Learning Resources

221116_Fine-Tuning Transformers.pdf
2MB
PDF

Until next week you should...

  • complete chapter 4 (Sharing Models and Tokenizers) and chapter 5 (The Datasets Library) of the Hugging Face course
  • do a literature review on the task of you project:
    • Search for transformer models applied to similar problems
    • Focus on the structure of the input and of the output
    • Are there pretrained models that you can use?
    • Which type of model is best suited? Do you need tokenization?
    • Do you need a type of embedding layer?