Study the paper

Attention Is All You Need

Lessons, visuals, quizzes, flashcards, and resources—organized in teaching order.

All activities

Introduction to the Transformer Architecture

Introduction to the Transformer Architecture

Card 1 of 2

What is the fundamental constraint of recurrent models regarding parallelization during training?