Definition. Prefix-window retained state [ftip-00DD]
Definition. Prefix-window retained state [ftip-00DD]
For prefix and window lengths \(p,w\in \mathbb N_0\), define the prefix-window policy by retaining every token in positions \(0,\ldots ,p-1\) and the most recent \(w\) tokens after that prefix. If the history is shorter than either region, the available positions are retained without padding.
The policy is a context rule only. It does not assert that omitted tokens are irrelevant, nor that the resulting continuation distribution equals the full-history distribution.