Skip to content

Limits table — the delivered form vs the registered baselines ​

Every registered opponent in bench/limits/ crossed with the named-optimization corpus (bench/discovery/cases/). ratio is baseline ÷ mlopt — the results-doc convention: >1× means the delivered form is ahead, ~1× is parity (a rediscovery of the known impl), <1× is an honest loss. caveat carries what the number hides: measured-only arms, scratch-dep skips, verify failures.

  • lane: fast (symbolic dag_cost)
  • date: 2026-10-20T00:10:29+00:00 · git: e7dc703 (dirty) · torch 2.14.0+cu130 on cpu
casecategorybaselinekindmloptbaselineratioverdictcaveat
blelloch_scanspeedeagereager7527591.01×parityno compilation — the unoptimized floor
blelloch_scanspeedhand_carriercarrier7527591.01×paritysame extracted term — executor routing is the delta
blelloch_scanspeedpaper_implimpl7521,4941.99×WINfrom bench.discovery.refs — the hand-built floor
blelloch_scanspeedtorch_compilecompile752———measured-only — no symbolic form
conv_bn_foldspeedeagereager27,64929,1861.06×WINno compilation — the unoptimized floor
conv_bn_foldspeedhand_carriercarrier27,649———no carrier executor claims the extraction — generic lowering would duplicate the mlopt arm
conv_bn_foldspeedpaper_implimpl27,64927,6491.00×parityfrom bench.discovery.refs — the hand-built floor
conv_bn_foldspeedtorch_compilecompile27,649———measured-only — no symbolic form
flash_attentionmemoryeagereager32,77233,5441.02×WINno compilation — the unoptimized floor
flash_attentionmemoryhand_carriercarrier32,772———no carrier executor claims the extraction — generic lowering would duplicate the mlopt arm
flash_attentionmemorypaper_implimpl32,77232,7721.00×parityfrom bench.discovery.refs — the hand-built floor
flash_attentionmemorytorch_compilecompile32,772———measured-only — no symbolic form
mul_unsq_natspeedeagereager50751.50×WINno compilation — the unoptimized floor
mul_unsq_natspeedhand_carriercarrier50———no carrier executor claims the extraction — generic lowering would duplicate the mlopt arm
mul_unsq_natspeedpaper_implimpl50501.00×parityfrom bench.discovery.refs — the hand-built floor
mul_unsq_natspeedtorch_compilecompile50———measured-only — no symbolic form
retnet_chunkwisememoryeagereager761,862761,8631.00×parityno compilation — the unoptimized floor
retnet_chunkwisememoryflakernel761,862———fla not installed (scratch dep)
retnet_chunkwisememoryhand_carriercarrier761,862———no carrier executor claims the extraction — generic lowering would duplicate the mlopt arm
retnet_chunkwisememorypaper_implimpl761,862491,6560.65×lossfrom bench.discovery.refs — the hand-built floor
retnet_chunkwisememorytorch_compilecompile761,862———measured-only — no symbolic form
swiglu_mlpspeedeagereager4,3554,3561.00×parityno compilation — the unoptimized floor
swiglu_mlpspeedhand_carriercarrier4,355———no carrier executor claims the extraction — generic lowering would duplicate the mlopt arm
swiglu_mlpspeedpaper_implimpl4,3554,4851.03×WINfrom bench.discovery.refs — the hand-built floor
swiglu_mlpspeedtorch_compilecompile4,355———measured-only — no symbolic form
weight_chain_foldspeedeagereager2,0494,0982.00×WINno compilation — the unoptimized floor
weight_chain_foldspeedhand_carriercarrier2,049———no carrier executor claims the extraction — generic lowering would duplicate the mlopt arm
weight_chain_foldspeedopt_einsumorder2,049———ordering, not a graph — measured-only
weight_chain_foldspeedpaper_implimpl2,0492,0491.00×parityfrom bench.discovery.refs — the hand-built floor
weight_chain_foldspeedtorch_compilecompile2,049———measured-only — no symbolic form

The registered roster ​

  • eager (eager) — PyTorch eager — the spelled module, as written · all cases · record: launch-bound crossover: carriers lose to eager below ~T=512 (0.51×, docs/results.md)
  • fla (kernel) — FLA chunk_retention — the Triton-kernel floor · cases: retnet_chunkwise · record: ~7–11× ahead of the fused carrier — kernel-level: fp64 GEMMs + a materialized score tensor on our side (bench/drivers/probes/retnet_baseline_probe.py)
  • hand_carrier (carrier) — carrier term, generic lowering (no batched schedule) · all cases · record: 0.51× vs eager below the T=512 crossover — the carrier without its level-batched schedule (docs/results.md)
  • opt_einsum (order) — opt_einsum greedy — the contraction-ordering baseline · cases: weight_chain_fold · record: oe-greedy is the contraction board's floor — the engine's ordering players tie its cost under the shared pair model (bench/players leaderboard)
  • paper_impl (impl) — known-good impl — the case's registered ref · all cases · record: paper chunkwise ties the fused carrier (2.08 vs 2.12 ms T=2048; faster under graph replay) — bench/drivers/probes/retnet_baseline_probe.py
  • torch_compile (compile) — torch.compile — the Inductor pipeline · all cases · record: pointwise fusion 0.82–0.88× loss (Inductor wins); weight chain 3.96× mlopt (no fold without freezing) — docs/results.md