{"resourceId":"arxiv-sol-pi-260920519","versions":[{"version":"external-775c940a26ece947e676b4f1f6ffeb058427c499c3bcc07db14cc37b7a404e79","resource":{"id":"arxiv-sol-pi-260920519","title":"SoL-Pi (arXiv:2609.20519): harness-layer loops cut coding-agent tokens 44.7–49.0%","organization":"arXiv (NVIDIA-affiliated authors)","sector":"Academic systems research / agent harness efficiency","geography":"Global (preprint; lab transferability limited by harness assumptions)","publishedAt":"2026-09-17T00:00:00Z","publicationDate":"2026-09-17","eventDate":"2026-09-17","sourceName":"arXiv","sourceLabel":"Academic preprint","sourceUrl":"https://arxiv.org/abs/2609.20519","evidenceClass":"academic-research","outcomeClass":"emerging","topics":["developers-agents","operating-model","infrastructure"],"finding":"arXiv:2609.20519 (submitted 17 Sep 2026) presents SoL-Pi, an RSI-inspired approach that optimizes the coding-agent harness rather than only the model. On the 51-task EdgeBench evaluation, the abstract states SoL-Pi achieves performance comparable to Pi across GPT-5.6 Sol and Opus 5 while reducing recorded token traffic by 44.7–49.0% and API cost by about one third. Why now: Sep 26 independent THE DECODER coverage made the preprint newly salient for agent-ops cost control after the prior nvidia edition.","sledRelevance":"Campus teams paying token bills for coding agents can evaluate harness-layer efficiency controls; results are benchmark-bound, not guaranteed campus savings.","evidence":"arXiv abs page; submitted 17 Sep 2026; EdgeBench 51-task claim and 44.7–49.0% token / ~1/3 API cost figures from abstract.","architectureImplications":"Agent platforms should treat harness policies as first-class tunable components beside model choice.","governanceImplications":"Who approves auto-research loops that rewrite harness behavior in production developer environments?","securityPrivacyImplications":"Harness optimizers that read traces may expose proprietary code or prompts if logs leave the security boundary.","caveats":"Preprint; EdgeBench/Pi-specific; recursive self-improvement framing is aspirational beyond measured EdgeBench results; NVIDIA-affiliated authorship.","streamIds":["nvidia"],"roles":{"sales":"Position SoL-Pi as a harness-efficiency research signal for expensive coding agents—not a SKU to bundle into every deal. Open with token-cost pressure on unattended agent runs, then cite the Sep 17 arXiv abstract’s 44.7–49.0% EdgeBench token reduction with comparable Pi performance. Why now: Sep 26 independent coverage. Bound any pilot to a non-production sandbox with explicit spend caps; do not promise half-price campus coding from the preprint alone.","engineering":"Fit is experimental for teams already on Pi-like harnesses; weak if agents are thin wrappers without traceable harness layers. Integrate SoL-Pi ideas as optional policies behind feature flags. Prerequisites: agent trace logging, an EdgeBench-like eval, spend telemetry. Constraints: preprint results on named model pairs; auto-research loops can regress quality. Proof: token and pass metrics on a frozen internal task set before and after harness changes.","delivery":"Work: stand up sandbox agent, enable harness candidates, run EdgeBench-like eval, review diffs from auto-research loops. Dependencies: API budgets, secure trace storage, human approval gates. Ownership: developer platform team. Skills: agent eval engineering. Governance: forbid unsupervised harness writes to production. Acceptance: agreed token drop without exceeding quality delta on internal tasks. Risks: eval overfitting, leaking code via traces, chasing preprint numbers without local proof."},"roleDetails":{"sales":{"customerProblem":"Unattended coding agents burn tokens on long trajectories even when task success is flat.","stakeholders":["developer platform","FinOps","security","engineering leadership"],"discoveryQuestions":["What is monthly coding-agent token spend?","Do you control harness policies separately from models?","What quality floor is non-negotiable?"],"valueHypothesis":"Harness-layer optimisation may cut token traffic ~45–49% on EdgeBench-like work if quality holds.","potentialEngagement":"Time-boxed sandbox eval of SoL-Pi-style harness policies on an internal coding-agent fleet.","unsupportedClaims":["Guaranteed 49% savings in production","Works for every agent framework","Recursive self-improvement is proven on campus workloads"]},"engineering":{"fit":"Experimental for Pi-compatible harnesses with traceable control layers.","architectureIntegration":"Policy modules for context compaction/action fusion behind flags; keep model endpoint swappable.","prerequisites":["Trace logging","Eval suite","Spend telemetry","Rollback of harness config"],"constraints":["Preprint EdgeBench scope","Model-pair specificity","Auto-research may regress"],"security":"Keep traces inside tenancy; redact secrets before any optimiser prompt.","proofOfValue":["Token traffic delta","Task success delta","API cost delta on frozen suite"]},"delivery":{"work":"Sandbox deploy, run evals, human-review harness diffs, decide promote/kill.","dependencies":["API keys/budget","Secure logs","Eval dataset owners"],"ownership":"Developer platform engineering.","skillsAdoption":"Train platform engineers on harness eval reporting.","governanceCheckpoints":["No unsupervised prod harness writes","Spend ceiling review"],"acceptanceCriteria":["Documented token/quality report on internal suite","Rollback tested"],"risks":["Overfitting to EdgeBench","Trace leakage","Quality regressions"]}},"retrievedAt":"2026-09-27T02:58:40Z","enrichedAt":"2026-09-27T03:05:00Z","enrichmentBasis":"retrieved source","accessibilityWorkforceImplications":"Lower token cost can widen agent access, but harness tuning still needs specialized platform skills.","procurementImplications":"Prefer evaluating open harness techniques before purchasing additional model capacity solely for agent volume.","operatingModelImplications":"Separate ownership of harness policy from model vendor management.","sourceVerification":{"openedUrl":"https://arxiv.org/abs/2609.20519","referenceExcerpt":"reducing recorded token traffic by 44.7-49.0% and API cost by about one third","promptVersion":"sled-research-v4.0","model":null,"basis":"agent-reported inspection"}}}]}