Library

My evolving library of incredible things.

Incredible technical resources

Getting started in deep learning

• Understanding Deep Learning (my favourite textbook ever)
• Neural Networks: Zero to Hero
• A Recipe for Training Neural Networks
• Ilya Sutskever's reading list

Opinion Pieces

• The Bitter Lesson
• Computers can be understood

Modern deep learning algorithms

• Modern Gen-AI models: https://sander.ai/2025/04/15/latents.html
• Transformers
  • The Illustrated Transformer
  • The Annotated Transformer
• Diffusion models
  • Chapter in Prince
  • DDPM paper
• Flow matching
• Convolutional Neural Networks

Efficiency optimization of deep learning

• How to make deep learning go brrr
• How to Train Really Large Models on Many GPUs?
• How to Scale Your Model
• Memory and latency profiling in PyTorch:
  • How to Accurately Time CUDA Kernels in Pytorch
  • Understanding GPU Memory
  • PyTorch Profiler Recipe

Other explainers

• AI Safety for Fleshy Humans

Great blog posts

For anyone and everyone:

• High Agency - George Mack
• Learn in Public - Shawn Wang
• 6 Harsh Truths That Will Make You a Better Person - Jason Pargin
• Things you learn dating Cate Hall - Sasha Chapin

Research-specific ones:

• You and Your Research - Richard Hamming
• An Opinionated Guide to ML Research - John Schulman
• Reflections two years into the PhD - Trenton Bricken

Wacky proposals:

• Vitalik's d/acc
• Suffering abolishment
• BCI/acc
• (suggestions at the end) https://80000hours.org/problem-profiles/risks-from-power-seeking-ai/#section-five

Incredible films

• Parasite
  • Probably the most flawless and unique film I have ever seen, never seen anything like it.
• Bones and All
  • Who knew cannibal body horror could be so heartwarming and relatable? Cannibalism is a metaphor for addiction and the struggle for acceptance and belonging.
• Whiplash
  • Every scene adds so much. Zero wasted time.
• Don't look up
  • Hilarious and upsettingly-accurate allegory of society's failure to address serious issues like climate change.
• The Big Lebowski
  • This film is such a vibe that it actually started a religion: Dudeism.
• Kill Bill
  • Just incredibly entertaining and fun - a real "movie".
• The notebook
  • I really liked it - I'm comfortable admitting that.
• The Grand Budapest Hotel
  • Impeccable style of filmmaking.
• The Silence of the Lambs
  • Absolute classic with the right amount of "edge" to it.
• The social network
  • I don't think this film gives a very fair impression of the real people, but it is still a very good watch.
• Bruno
  • Sacha Baron Cohen has balls of steel.
• Inglorious Bastards
• Uncut Gems
  • Amazing and stressful.
• Boogie Nights
  • Absolute chaos
• The Game
  • Wild ride
• Fight Club
• Pulp Fiction