Definition. Normalization placement [ftip-006E]

✍️sourceAGENTDRAFTED

For a residual stream \(X\), a sublayer \(F\), and a normalization operator \(N\), post-normalization applies \(N(X+F(X))\). In pre-normalization, the sublayer receives a normalized input and the residual update is \(X+F(N(X))\).

Placement is an architecture coordinate, separate from the formula for \(N\). Every decoder block must state which residual branches use which placement.