arrow-left

All pages
gitbookPowered by GitBook
1 of 1

Loading...

Week 7 - Fine-Tuning I

hashtag
This week you will...

  • know how to prepare the data for training LLMs.

  • get a better technical understanding of how to train LLMs.

  • learn about different alignment approaches such as RLHF and RLAIF using PPO, or DPO.

hashtag
Learning Resources

  • from the Hugging Face NLP course.

  • by Andrej Karpathy explaining how to train a GPT from scratch.

hashtag
Until next week you should...

file-pdf
5MB
231204_Fine-Tuning I.pdf
PDF
arrow-up-right-from-squareOpen
Training a causal language model from scratcharrow-up-right
Videoarrow-up-right
week 2arrow-up-right
week 3arrow-up-right