Revision

General presentation of a Neural Network

Introduction

Backpropagation and Gradient descent

Initialisation

Activation functions

Batch normalization

Regularization (\(L_1\), \(L_2\), Max norm, Dropout)

Common training problems (Vanishing/Exploding gradient)

Applications and specific network architectures

CNN for computer vision

NLP