Archives
All the articles I've archived.
2025 1
November 1
-
RMSNorm Backward: From Derivation to a Triton Kernel
Derive RMSNorm backward step by step and implement a Triton kernel with PyTorch, numerics tips