You are reading immutable version 40. The current guide may be newer.

Study the paper

Attention Is All You Need

Lessons, visuals, quizzes, flashcards, and resources—organized in teaching order.

All activities

Empirical Evaluation and Generalization

Table 4: F1 scores for English constituency parsing

Interactive study view

Table 4: F1 scores for English constituency parsing

Paper evidence + deterministic derivation

Explore paper-reported results and reconciled deterministic comparisons.

Table 4: F1 scores for English constituency parsing data
labellabelsource valuelabelProvenance
F1 score improvement of semi-supervised Transformer over WSJ-only TransformerDerived comparison1.4F1Deterministic derivation
Transformer (4 layers) semi-supervised F1WSJ 23 F192.7F1Paper evidence
Transformer (4 layers) WSJ only F1WSJ 23 F191.3F1Paper evidence