# Week 4 - Fine-Tuning Pretrained Models

### This week you will...

* learn how to fine-tune a Hugging Face model with your own data

### Learning Resources

{% file src="https://4020123021-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MHobCAnoTQkN71lOgdv%2Fuploads%2FpjU74ab7jYi1fkHDngh1%2F221116_Fine-Tuning%20Transformers.pdf?alt=media&token=a8e2f9f9-5607-400f-b49c-fbe31e21d273" %}

### Until next week you should...

* [x] complete [chapter 4](https://huggingface.co/course/chapter4/1) (Sharing Models and Tokenizers) and [chapter 5](https://huggingface.co/course/chapter5/1) (The Datasets Library) of the Hugging Face course
* [x] do a literature review on the task of you project:
  * Search for transformer models applied to similar problems
  * Focus on the structure of the input and of the output
  * Are there pretrained models that you can use?
  * Which type of model is best suited? Do you need tokenization?
  * Do you need a type of embedding layer?
