You are reading immutable version 5. The current guide may be newer.

Study the paper

Deep Residual Learning for Image Recognition

Lessons, visuals, quizzes, flashcards, and resources—organized in teaching order.

All activities

Mathematics of Identity Shortcuts and Dimension Matching

Residual Block with Projection Shortcut: step by step

Interactive study view

Residual Block with Projection Shortcut: step by step

Illustrative teaching data

Follow the existing bounded walkthrough in its intended sequence.

Step 1 of 5

  1. Step 1

    Define input vector x of dimension 2.

  2. Step 2

    Define residual mapping output F(x) of dimension 3.

  3. Step 3

    Define projection matrix W_s of dimension 3x2.

  4. Step 4

    Compute W_s * x to project input to dimension 3.

  5. Step 5

    Add F(x) and W_s * x to obtain the final output y.