Build and train neural networks from scratch: CNNs, Transformers, Diffusion Models, and RL agents.
Created by Marcus Johnson
From first principles to cutting-edge research. This course goes beyond tutorials to build real understanding of how deep learning works. You'll implement neural networks from scratch in NumPy, then leverage PyTorch 2.4 for modern architectures. Topics: automatic differentiation, CNNs, ResNets, Transformers (from scratch), ViTs, diffusion models, reinforcement learning basics, and how to read ML papers.
4 lectures · 320 min total
Marcus holds a PhD in Computer Science from MIT with a focus on deep learning. He spent 4 years at Google Brain and has published 12 peer-reviewed papers. His mission is to demystify AI for working engineers and make cutting-edge ML techniques practical.
Building a transformer from scratch is exactly what I needed to move from 'using AI tools' to 'understanding AI systems'. Marcus's intuition-first approach is world-class. Definitely my favorite course on this platform.
I have a statistics background and even I learned things I didn't expect in this course. The backpropagation chapter with visualizations is the best I've ever seen — beats any textbook I've used.
Very demanding but completely worth it. The CNN and RNN sections are exceptional. I'd recommend having solid Python skills before starting, but if you do, this will take you very far.
I have a CS background and this is still the most illuminating course I've taken on deep learning. Building a Transformer from scratch finally made me understand attention. A masterpiece.