2: How the backpropagation algorithm works

Neural networks and deep learning

Intro

Warm up: a fast matrix-based approach to computing the output from a neural network

The two assumptions we need about the cost function

The Hadamard product, s⊙t

The four fundamental equations behind backpropagation

Problem

Proof of the four fundamental equations (optional)

Exercise