Week 7 - Transformers & Hugging Face

Course session

Explanatory Session Part 1

Self-attention and multihead attention

Hugging Face Introduction

Library and Use of HuggingFace for working with transfomer models

Google Colaboratory

Explanatory Session Part 2

Transformer Encoder and Positional Encoding

Explanatory Session Part 3

Vision Transformer

Walk-through

Finetuning Vision Transformer on Kaggle Paddy Dataset

Google Colaboratory

To-do

😊

Look at current Kaggle competitions and make proposals

😊😊

Go through this excellent site explaining Transformers:

The Illustrated Transformer

Do Chapter 1-3 of the HuggingFace NLP course

Introduction - Hugging Face NLP Coursehuggingface

😊😊😊

Tutorial 6: Transformers and Multi-Head Attention — UvA DL Notebooks v1.1 documentation

Look closer at the Pytorch module nn.Transformer (documentation) and go through a tutorial on how to use it for next token prediction.

Watch this excellent "Build from Scratch" video from Andrej Karpathy

Tutorial 15: Vision Transformers — UvA DL Notebooks v1.2 documentation