Fixed-budget trace-selection protocol [ftip-00P3]
✍️sourceAGENTDRAFTED
Fixed-budget trace-selection protocol [ftip-00P3]
✍️sourceAGENTDRAFTED
The trace-selection intervention is a finite evaluation proposal. It compares horizon and selector choices at a declared retained budget while keeping the model, teacher, scaffold, task split, verifier, randomization law, and cost coordinates visible. The selective-refinement study supplies the comparison pattern; the typed interface, receipts, and estimators below are FTIP adaptations rather than source results [dang2026selecting, Sections 6-7; Tables 4-5, 10].
The route separates the experiment interface (Definition 1), its receipt-derived quantities (Definition 2), and a finite paired calculation (Example 3). No result is claimed until an implementation supplies the declared receipts.
Definition 1. Finite trace-selection experiment [ftip-00P8]AGENTDRAFTED
Definition 1. Finite trace-selection experiment [ftip-00P8]AGENTDRAFTED
The selective-refinement study compares fixed-horizon data interventions under a declared training and evaluation boundary [dang2026selecting, Sections 6-7; Tables 4-5, 10]. A trace-selection experiment is the following finite typed record.
Fix the P0 lifecycle arm set \(\mathcal A\), its boundary map \(r:\mathcal A\to \mathcal J\), mask map \(M:\mathcal A\to \mathcal P(\{s,h,w\})\), and endowment \(E_0\) from § [ftip-00P0] and § [ftip-00OY]. Choose finite nonempty label sets
\[ \mathfrak H\subset \mathbb N,\qquad \mathfrak L,\qquad \mathfrak B\subset \mathbb N_{>0},\qquad \mathfrak D,\qquad \mathfrak R. \]A split map returns a triple
\[ \operatorname {split}:\mathfrak D\longrightarrow \{(Q_{\rm sel},Q_{\rm hold},Q_{\rm xb})\mid Q_{\rm sel},Q_{\rm hold},Q_{\rm xb}\subseteq \mathcal Q\text { are finite}\}, \]whose three outputs are pairwise disjoint and satisfy \(|Q_{\rm sel}|>0\), \(|Q_{\rm hold}|>0\); \(Q_{\rm xb}\) may be empty only when the experiment records that no cross-benchmark comparison is made. A randomization map \(\lambda _{\rm pair}:\mathfrak R\to \operatorname {Dist}(\mathcal G\times \mathcal G)\) supplies a joint source law for each paired comparison.
The experiment declares a finite, nonempty arm set \(\mathfrak A\subseteq \mathcal A\times \mathfrak H\times \mathfrak L\times \mathfrak B\times \mathfrak D\times \mathfrak R\). For each \(a\in \mathfrak A\), write its projections as
\[ (a_0(a),H_a,\ell _a,B_a,D_a,\eta _a),\qquad r_a:=r(a_0(a)),\quad M_a:=M(a_0(a)),\quad \mathcal R_a:=\lambda _{\rm pair}(\eta _a). \]The arm record additionally supplies one model, teacher, scaffold, verifier, task law, inference protocol, and componentwise budget. These objects are maps of \(a\), not implicit labels; paired arms must agree on every object except the factor named by their comparison. The split attached to \(D_a\) is written \((Q_{\rm sel,a},Q_{\rm hold,a},Q_{\rm xb,a})\); it also supplies a nonempty finite strategy-label set \(\mathfrak S_a\) and a receipt space \(\mathcal R_a^{\rm rec}\) containing a typed held-out outcome \(Y_a\in \mathcal Y_a\cup \{\bot \}\), a declared scalarization \(g_a:\mathcal Y_a\to \mathbb R\), and an admission field. For every paired comparison \((a,a')\), the record additionally declares the finite pairing space \(\mathcal P_{a,a'}:=(Q_{\rm hold,a}\cap Q_{\rm hold,a'}) \times \mathfrak S_a\times \mathfrak S_{a'}\) and a law \(\Lambda _{a,a'}\) on \(\mathcal G\times \mathcal G\times \mathcal P_{a,a'}\). The shared task coordinate in this law is the pairing key; the two strategy coordinates may differ.
For each arm, let \(\mathcal X^{\rm sel}_a\) be the finite candidate-pool space with \(1\leq B_a\leq |\mathcal X^{\rm sel}_a|\), and let \(\mathcal F^{\rm sel}_a\) be the sigma-field generated by the selection-time prefix, teacher-forced score, data-only trace metadata, and \(Q_{\rm sel,a}\). The metadata map excludes held-out outcomes, verifier outcomes, and post-selection continuation events. The selector is a measurable kernel with respect to this sigma-field
\[ \mathsf S_{a,\ell _a}:\mathcal X^{\rm sel}_a \longrightarrow \operatorname {Dist}\bigl (\{I\subseteq \mathcal X^{\rm sel}_a: |I|=B_a\}\bigr ). \]It therefore returns a retained index set of the declared size without access to held-out outcomes. Write \(\mathcal I_a:=\{I\subseteq \mathcal X^{\rm sel}_a:|I|=B_a\}\). A run kernel
\[ \mathsf K^{\rm run}_{a,\ell _a}: \mathcal X^{\rm sel}_a\times \mathcal I_a\times \mathcal G \times \mathcal Q\times \mathfrak S_a \longrightarrow \operatorname {Dist}(\mathcal R_a^{\rm rec}) \]maps a candidate pool, its retained index set, one component of the paired source draw, a task, and its arm-specific strategy coordinate to a receipt with an event sequence, task and strategy labels, final verifier outcome, typed held-out outcome, admission field, state and artifact hashes, and the charged token, tool, storage, restart, discarded trace, and verification costs, with exactly \(H_a+1\) event slots and a timeout receipt at the final slot when needed. For a paired comparison, \(\Lambda _{a,a'}\) supplies a common held-out task and the two strategy coordinates, while \(\mathcal R_a\) supplies the two source components before the kernels are applied. Thus an arm defines maps and kernels that use the selector output to produce replayable receipts; it does not merely list factors whose later meaning is left implicit.
The reset transition is \(\mathsf {Reset}_{r_a,M_a}\) from § [ftip-00P0]. Horizon, selector, budget, split, and randomization are therefore attached to a concrete P0 state boundary and a concrete run kernel. This is an empirical protocol definition, not a theorem or a claim that any selector improves behavior.
Definition 2. Receipt metrics and paired contrasts [ftip-00P9]AGENTDRAFTED
Definition 2. Receipt metrics and paired contrasts [ftip-00P9]AGENTDRAFTED
The source compares retained-horizon choices under declared task and evaluation boundaries [dang2026selecting, Sections 6-7; Tables 4-5, 10]. Fix an arm \(a\in \mathfrak A\) from Definition 1 and a positive run count \(N_a\). Each receipt \(R_{a,i}\) exposes a finite event sequence \((e^{\rm term},e^{\rm ev},e^{\rm pass},e^{\rm fail},e^{\rm rec}, n^{\rm prod})_{t=0}^{H_a}\), a task label \(q_{a,i}\), a strategy label \(s_{a,i}\), a measurable task-value score \(u_{a,i}(t)\), a declared saturation threshold \(u_a^{\rm sat}\), and a typed held-out outcome \(Y_{a,i}\in \mathcal Y_a\cup \{\bot \}\), final verifier outcome \(v_{a,i}\), and complete-admission indicator \(A_{a,i}\). Define \(A_{a,i}:=\mathbf 1[q_{a,i}\in Q_{\rm hold,a}\land v_{a,i}=1 \land Y_{a,i}\in \mathcal Y_a]\); when \(A_{a,i}=0\), set \(Y_{a,i}:=\bot \). The receipt contract emits a terminal event by \(H_a\); an execution that would not terminate naturally receives a timeout terminal event at \(H_a\) and \(A_{a,i}=0\). Put \(\overline {\mathbb N}:=\mathbb N\cup \{+\infty \}\) and \(\inf \varnothing :=+\infty \).
\[ \tau ^{\rm end}_{a,i}:=\inf \{t:e^{\rm term}_{a,i}(t)=1\},\quad \tau ^{\rm ev}_{a,i}:=\inf \{t:e^{\rm ev}_{a,i}(t)=1\},\quad \tau ^{\rm pass}_{a,i}:=\inf \{t:e^{\rm pass}_{a,i}(t)=1\}, \]\[ \tau ^{\rm fail}_{a,i}:=\inf \{t:e^{\rm fail}_{a,i}(t)=1\},\quad \tau ^{\rm rec}_{a,i}:=\inf \{t:e^{\rm rec}_{a,i}(t)=1\},\quad \tau ^{\rm sat}_{a,i}:=\inf \{t:u_{a,i}(t)\geq u_a^{\rm sat}\}. \]Define the receipt predicates
\[ \begin {aligned} I^{\rm pre}_{a,i}&:=\mathbf 1[\tau ^{\rm end}_{a,i}<\tau ^{\rm ev}_{a,i}],\\ I^{\rm rec}_{a,i}&:=\mathbf 1[\tau ^{\rm fail}_{a,i}<\tau ^{\rm rec}_{a,i}<\tau ^{\rm end}_{a,i}],\\ I^{\rm prod}_{a,i}&:=\mathbf 1[\tau ^{\rm ev}_{a,i}<\tau ^{\rm end}_{a,i} \land \tau ^{\rm pass}_{a,i}<\tau ^{\rm end}_{a,i} \land (\tau ^{\rm fail}_{a,i}\geq \tau ^{\rm end}_{a,i} \lor I^{\rm rec}_{a,i}=1)],\\ I^{\rm over}_{a,i}&:=\mathbf 1[\tau ^{\rm sat}_{a,i}<\tau ^{\rm end}_{a,i} \land \sum _{t=\tau ^{\rm sat}_{a,i}}^{\tau ^{\rm end}_{a,i}-1} n^{\rm prod}_{a,i}(t)=0]. \end {aligned} \]Here \(n^{\rm prod}_{a,i}(t)\) is a declared productive-novelty indicator in the receipt, and \(I^{\rm rec}\) is zero when no failure precedes recovery. The five run rates are functions of the receipts, with the declared denominator \(N_a\):
\[ (\widehat p_a^{\rm pre},\widehat p_a^{\rm prod},\widehat p_a^{\rm over}, \widehat p_a^{\rm rec},\widehat p_a^{\rm pass}) :=\frac 1{N_a}\sum _{i=1}^{N_a} (I^{\rm pre}_{a,i},I^{\rm prod}_{a,i},I^{\rm over}_{a,i}, I^{\rm rec}_{a,i},\mathbf 1[\tau ^{\rm pass}_{a,i}<\tau ^{\rm end}_{a,i}]). \]For the finite held-out set, task and strategy coverage are
\[ \widehat C^{\rm task}_a:= \frac {|\{q\in Q_{\rm hold,a}:\exists i,\ q_{a,i}=q,\ A_{a,i}=1\}|} {|Q_{\rm hold,a}|},\qquad \widehat C^{\rm strat}_a:= \frac {|\{s\in \mathfrak S_a:\exists i,\ s_{a,i}=s,\ A_{a,i}=1\}|} {|\mathfrak S_a|}, \]where \(\mathfrak S_a\) is a declared nonempty strategy-label set. Every receipt reports both positive denominators and the admission rule.
For two paired arms \(a\) and \(a'\) that differ in one declared factor, let \(N:=\min (N_a,N_{a'})\). Define the common admitted index set \(J_{a,a'}:=\{i\leq N:A_{a,i}=A_{a',i}=1\}\) and \(N_{\rm pair}:=|J_{a,a'}|\). For \(i\in J_{a,a'}\), let \(Y_{a,i}\) and \(Y_{a',i}\) be their admitted held-out outcomes under the shared pairing law \(\Lambda _{a,a'}\), so \(q_{a,i}=q_{a',i}\). Compare their declared scalarizations \(g_a(Y_{a,i})\) and \(g_{a'}(Y_{a',i})\). When \(N_{\rm pair}\geq 2\), the primary finite contrast and its paired sample variance are
\[ \widehat \Delta _{a,a'}:= \frac 1{N_{\rm pair}}\sum _{i\in J_{a,a'}} \bigl (g_a(Y_{a,i})-g_{a'}(Y_{a',i})\bigr ),\qquad \widehat V_{a,a'}:= \frac 1{N_{\rm pair}-1}\sum _{i\in J_{a,a'}} \bigl ((g_a(Y_{a,i})-g_{a'}(Y_{a',i}))-\widehat \Delta _{a,a'}\bigr )^2. \]When \(N_{\rm pair}=1\), report the single paired contrast but set \(\widehat V_{a,a'}:=\bot \); when \(N_{\rm pair}=0\), the paired contrast is undefined and the missingness is reported. These are finite estimators under the declared arm, split, admission rule, and coupling; they are not a universal selector law.
Example 3. A paired trace-selection calculation [ftip-00PA]AGENTDRAFTED
Example 3. A paired trace-selection calculation [ftip-00PA]AGENTDRAFTED
The selective-refinement comparison motivates contrasting repeatability and coverage under a fixed retained budget [dang2026selecting, Sections 6-7; Tables 4-5, 10]. Consider two arms from Definition 1 with the same P0 boundary, model, task split, verifier, budget, and paired assignment law. They differ only in the selector: \(a\) retains the highest teacher-forced scores and \(a'\) retains a coverage-stratified subset. Both have \(Q_{\rm hold}=\{q_1,q_2\}\) and \(\mathfrak S=\{s_1,s_2\}\). The paired assignment law gives the same held-out task at indices 1 and 2; arm \(a'\) has one additional admitted coverage run at index 3. Take \(g_a=g_{a'}=\operatorname {id}_{\{0,1\}}\). The receipts are
\[ \begin {array}{c|cc|ccc} &q_{a,i}&s_{a,i}&A_{a,i}&I^{\rm prod}_{a,i}&Y_{a,i}\\\hline i=1&q_1&s_1&1&1&1\\ i=2&q_1&s_1&1&1&0 \end {array} \qquad \begin {array}{c|cc|ccc} &q_{a',i}&s_{a',i}&A_{a',i}&I^{\rm prod}_{a',i}&Y_{a',i}\\\hline i=1&q_1&s_1&1&1&1\\ i=2&q_1&s_1&1&1&1\\ i=3&q_2&s_2&1&1&1 \end {array} \]The first two rows are the common paired indices, so \(N_a=2\), \(N_{a'}=3\), and \(N_{\rm pair}=2\). Both arms have \(\widehat p^{\rm prod}=1\); the third row is included in arm \(a'\)'s coverage and run-rate denominators but not in the paired contrast. Thus \(\widehat C^{\rm task}_a=\widehat C^{\rm strat}_a=\tfrac 12\) and \(\widehat C^{\rm task}_{a'}=\widehat C^{\rm strat}_{a'}=1\), while \(\widehat \Delta _{a,a'}=-\tfrac 12\). The calculation shows why a repeatability rate alone cannot identify coverage: the two selectors have the same productive rate but different admitted task and strategy support. This is a finite FTIP construction using the typed receipt and pairing definitions, not a source result.