Week 6 - The Tokenizers Library

This week you will...

• get insights on the benefits of the Hugging Face Tokenizers library

• discuss the characteristics of the data you use in your project

Learning Resources

2MB

221130_The Tokenizers Library.pdf

PDF

Open

Until next class you should...

• complete at least two sections from chapter 7 (Main NLP Tasks) of the Hugging Face course

• calibrate a baseline model