Deep Learning Topics

Foundations of Neural Networks

• Perceptrons & Multilayer Neural Networks
• Backpropagation & Training Deep Nets

• Optimization (SGD, Momentum, etc.)

Convolutional & Recurrent Architectures

Attention & Transformers

Generative Models