Definition. Estimator-changing training coordinate [ftip-00DQ]
Definition. Estimator-changing training coordinate [ftip-00DQ]
An estimator-changing coordinate is a change in \(\widehat g\), the map used to turn sampled histories and rewards into an update. A context mask can change this coordinate when it changes which tokens contribute to the sampled loss or gradient. The notation does not assume a particular optimizer.