You are reading immutable version 3. The current guide may be newer.

Study the paper

Deep Residual Learning for Image Recognition

Lessons, visuals, quizzes, flashcards, and resources—organized in teaching order.

All activities

Mathematical Formulation of ResNets

Identity Shortcut Connection: step by step

Interactive study view

Identity Shortcut Connection: step by step

Illustrative teaching data

Follow the existing bounded walkthrough in its intended sequence.

Step 1 of 5

  1. Step 1

    Compute F_1 = W_11 * x_1 + W_12 * x_2 = 0.1 * 1.0 + 0.2 * 2.0 = 0.5

  2. Step 2

    Compute F_2 = W_21 * x_1 + W_22 * x_2 = 0.3 * 1.0 + 0.4 * 2.0 = 1.1

  3. Step 3

    Add shortcut connection: y_1 = F_1 + x_1 = 0.5 + 1.0 = 1.5

  4. Step 4

    Add shortcut connection: y_2 = F_2 + x_2 = 1.1 + 2.0 = 3.1

  5. Step 5

    Sum of output elements for verification: 1.5 + 3.1 = 4.6