Study the paper

Attention Is All You Need

Lessons, visuals, quizzes, flashcards, and resources—organized in teaching order.

Empirical Evaluation and Generalization

Card 1 of 2

How did the big Transformer perform on the WMT 2014 English-to-German translation task compared to previous models?