You are reading immutable version 28. The current guide may be newer.

Study the paper

Attention Is All You Need

Lessons, visuals, quizzes, flashcards, and resources—organized in teaching order.

All activities

Empirical Performance and Generalization

BLEU scores and training costs on WMT 2014 translation tasks

Interactive study view

BLEU scores and training costs on WMT 2014 translation tasks

Paper evidence + deterministic derivation

Explore paper-reported results and reconciled deterministic comparisons.

BLEU scores and training costs on WMT 2014 translation tasks data
labellabelsource valuelabelProvenance
Improvement of Transformer (big) over Transformer (base) on EN-DEDerived comparison1.1BLEUDeterministic derivation
Transformer (base model) EN-DE BLEUBLEU27.3BLEUPaper evidence
Transformer (base model) EN-FR BLEUBLEU38.1BLEUPaper evidence
Transformer (big) EN-DE BLEUBLEU28.4BLEUPaper evidence
Transformer (big) EN-FR BLEUBLEU41.8BLEUPaper evidence