Clear explanations of things worth understanding — documented so I don’t have to figure them out twice!

Notes

DomainDescription
AI & MLNeural networks, transformers, training, inference, alignment
MathematicsAnalysis, probability, linear algebra, information theory
Computer HardwareDRAM, CPU, GPU, storage, hardware architecture toward CUDA
PhysicsNuclear, electromagnetism, quantum mechanics, astrophysics
EngineeringData engineering, software systems, infrastructure
More soonNext up: Build GPT from scratch (implementing this series)

Implementations

See Implementations for hands-on builds and reimplementations in Python (Jupyter notebooks).