You are reading immutable version 39. The current guide may be newer.

Study the paper

Attention Is All You Need

Lessons, visuals, quizzes, flashcards, and resources—organized in teaching order.

All activities

Empirical Results and Performance

English Constituency Parsing Results

Interactive study view

English Constituency Parsing Results

Paper evidence + deterministic derivation

Explore paper-reported results and reconciled deterministic comparisons.

English Constituency Parsing Results data
labellabelsource valuelabelProvenance
F1 score improvement of semi-supervised Transformer over discriminative TransformerDerived comparison1.4F1Deterministic derivation
Transformer (4 layers) semi-supervised F1WSJ 23 F192.7F1Paper evidence
Transformer (4 layers) WSJ only discriminative F1WSJ 23 F191.3F1Paper evidence