0-Call Engine & Verification Slot
Public-suite adapter, holdout isolation guard & generalization-gap scorer
Substrate: db_atomic · p99 Claim Target: ≤ 5 ms · Phase: 45 - 48 SCD2 Context Packs, Self-Awareness, Benchmarks & Jagged Frontier
Benchmark Public & Custom (aq47_benchmark_public_and_custom)
Evaluates harnesses, packs, and engines side-by-side on public benchmarks and leak-free custom Teleon ScenarioIR holdouts against bare baselines.
7 Public SuitesContamination-Free HoldoutBaseline Delta
Model-Guided Escalation & Synthesis Role
Benchmark harness integrator & contamination auditor
5-Role Component Pod: 0-Call Slot / Solver + OpenSearch / Split-Supervisor (≤4k tok) / Diagnostic Repair + Twin Shim / CPOP + Sister Distiller.
Enforced Category State Machine: rux_harness_benchmark_audit
Commit Invariant: Enforces identical tool/prompt scaffold parity across models on uncontaminated holdouts and flags scaffold inflation whenever retry budgets or custom wrappers diverge.
Architectural Problem Solved: Separates genuine model or substrate lift from benchmark-specific scaffold gaming.
POST https://api.teleon.dev/v1/tenants/:tenantId/queues/aq47_benchmark_public_and_custom/enqueue
{
"queue_category": "rux_harness_benchmark_audit",
"priority": 80,
"payload": { "stage": "47", "objective": "Benchmark Public & Custom" }
}