Week 5: Transformers

[edit]

Nic Lane

Abstract:

This lecture will introduce transformers.

Slides

Material

You can find the Slides here

And here are three Colab notebooks from Google that you might find interesting.

• Vision Transformer Tutorial
• Transformer model for language understanding
• Transformers and Multihead Attention