Remark. Training masks change more than attention cost [ftip-00DR]
Remark. Training masks change more than attention cost [ftip-00DR]
If a retained-context rule is used during training, it can change the attention inputs, sampled continuation, loss support, and gradient estimator at once. A lower value of Definition [ftip-00DJ] is therefore not an isolated compute intervention unless the training estimator and all other coordinates are matched explicitly.