Tag: normalization

All the articles with the tag "normalization".

• RMSNorm Backward: From Derivation to a Triton Kernel

  1 Nov, 2025

  Derive RMSNorm backward step by step and implement a Triton kernel with PyTorch, numerics tips