Example. Parameter matching is not cost matching [ftip-00K6]
Example. Parameter matching is not cost matching [ftip-00K6]
Two models with equal parameter count can have different attention FLOPs, KV-cache memory, kernel utilization, and attainable context. Conversely, equal wall time can hide different hardware and precision. Therefore a parameter-matched result cannot by itself identify a compute frontier.