The most useful number OpenAI published at launch is not on its chart. On ARC-AGI-3, GPT-6 Astra scored 99.9% under OpenAI's own Provider Adapter harness and 62.7% under ARC Prize's standard one. Same model, same tasks, same day.

The difference was scaffolding. And the run that scored 37 points higher was also the cheaper one.

Fig. 1
What travels between calls
One rebuilds. One remembers. FIVE SUCCESSIVE CALLS STANDARD HARNESS  /  CONTEXT REBUILT EACH TIME rebuildrebuildrebuildrebuildrebuild 62.7% $26,098 PROVIDER ADAPTER  /  STATE CARRIED, THEN COMPACTED carrycarrycompactcarrycompact 99.9% $18,817 THE BETTER RUN WAS ALSO THE CHEAPER ONE 3.66x faster by elapsed time  ·  49% fewer tokens  ·  $7,281 less Re-deriving what you already worked out is the expensive way to be wrong.
The compaction steps are the reason the adapter run stays bounded instead of growing until it falls off the end of the window.
Data: ARC Prize, September 3, 2026. Chart: nativefirst.ai

On ARC-AGI-3, Astra scored 99.9% under OpenAI's own Provider Adapter harness and 62.7% under ARC Prize's standard harness. Same model, same tasks. The difference is that the Provider Adapter preserves opaque reasoning state between requests and compacts long contexts, so the model reuses prior work instead of rebuilding it.

The cost detail is the part to internalise: the run that scored 37 points higher was also 3.66x faster, used 49% fewer tokens, and cost $7,281 less. Better scaffolding was not a tax on performance. It was the performance.

Greg Kamradt
Greg
Kamradt

"Saturating the benchmark would not represent proof of achieving AGI."

ARC Prize · September 3, 2026

Take the operator lesson rather than the AGI argument. A frontier lab found 37 points of capability by changing what the model carries between calls. Nobody has done that work on your workflows. Whatever you are running today is on the equivalent of the standard harness, and the gap between your current results and your achievable results is probably larger than the gap between two model versions.

Concretely, the three things the Provider Adapter did are three things you can do:

Carry state between calls instead of restarting the context each time. Compact rather than truncate when the context fills, so earlier work survives in summary instead of falling off the end. Let the model reuse its own prior reasoning rather than forcing it to re-derive. That is not exotic infrastructure. It is a week of plumbing on most stacks.

The three mechanisms, and why they are yours to copy

Nothing in the Provider Adapter is exotic. It does three things, and all three are available to anyone running an agent on any model.

Carry state between calls instead of rebuilding context each time. Compact rather than truncate when the window fills, so earlier work survives in summary instead of falling off the end. Let the model reuse its own prior reasoning rather than forcing it to re-derive what it already worked out.

That is a week of plumbing on most stacks, not a research programme. And the same three moves are what Anthropic runs in its own production on-call: standing instructions committed to git, a lessons log the agent appends to and re-reads at the start of every investigation, and an orchestrator that hands work to subagents instead of restarting a conversation.

The operator conclusion is uncomfortable in a useful way. A frontier lab found 37 points by changing what the model carries between calls. Nobody has done that work on your workflows. Whatever you run today is on the equivalent of the standard harness, and the gap between your current results and your achievable results is probably larger than the gap between two model versions.

Stop shopping for a better model until you have compacted the one you have.

What ARC Prize actually said

Worth reading the benchmark's own framing rather than the coverage of it. The standard harness is provider-neutral by design, so numbers can be compared across labs; under it a model carries forward only the notes it explicitly chooses to keep, and everything it is thinking stays visible and portable.

The Provider Adapter is a legitimate product capability, shipped in the Responses API, and OpenAI says the changes were not made for this benchmark. Both of those can be true while the comparison is still uneven, because the other models in the chart were not given the same scaffold. ARC Prize was careful about the conclusion, and the caution belongs next to the number: "saturating the benchmark would not represent proof of achieving AGI."

For scale, and this is the part that survives either reading: on the same neutral harness six months earlier, GPT-5.6 Sol scored 7.8% and Claude Opus 5 scored 30.2%. The jump is real whichever rig you use. It is the headline that is not reproducible outside OpenAI's own.

Turning it into topology

The engineering version of this lesson has a name and a set of rules. Treat the agent system as an explicit graph of nodes and data-contract edges rather than a chain of prompts, and three of the rules do the work here:

Keep durable state and pass artifact references, not transcripts. Handing a downstream step a whole conversation is how context rot spreads; handing it a pointer to a result is how state stays bounded.

Put verification on the edge, not at the end. Bad data should not be allowed to travel between nodes, because a long-horizon run compounds an early error for hours before anyone sees it.

Only add cycles with a completion test, a max round count and a token budget. An unbounded loop is not a design, it is a bill, and this model is priced to make that expensive quickly.

One line from that framing is the whole argument compressed: "the model is only one node. The product is the system around it."

Is your bottleneck the model or the harness?

Book a free Diagnostic: 30 to 45 minutes, no deck, no pitch. We audit what your agents carry between calls and where context is being thrown away.

Book the Diagnostic →

Part 2 of Working with GPT-6 Astra: The Operator Guide.

Sources
1ARC Prize, "OpenAI's GPT-6 Astra on ARC-AGI-3", September 3, 2026: 62.7% on the Semi-Private set at maximum reasoning effort under the Standard harness at a total cost of $26,098, versus 99.9% at high reasoning effort under the Provider Adapter harness at $18,817, which was ~3.66x faster by elapsed time and used 49% fewer tokens. The Provider Adapter "preserves opaque reasoning state between requests and uses compaction for longer conversations, allowing the model to reuse prior work"; the Standard harness carries forward only notes the model chooses to keep. Prior scores: Claude Opus 5 30.2%, GPT-5.6 Sol 7.8%. ARC Prize's caveat: "saturating the benchmark would not represent proof of achieving AGI." arcprize.org
2OpenAI, "GPT-6 Astra: A new generation of intelligence", September 3, 2026: claimed state of the art on FrontierMath Tier 4, ARC-AGI 3, TerminalBench-4.0, Terminal-Bench Science 0.1 and HealthBench Pro; ExploitBench 100% (GPT-5.6 Sol 78.5%); OSWorld 2.0 offline 72.6% (Sol 65.7%, Claude Opus 5 70.2%). Rollout via limited Daybreak Access, then ChatGPT Plus/Pro/Business/Enterprise, the API and AWS. Defensive cyber work supported; advanced offensive work such as proof-of-concept exploits refused. openai.com
3Simon Willison, "GPT-6 Astra", September 3, 2026, for pricing and the benchmark caveat: $10/million input and $50/million output, matching Claude Fable; "clearly OpenAI's Fable competitor"; on Artificial Analysis's Intelligence Index Astra scores 61, level with GPT-5.6 Sol and behind Claude Fable 5.1 at 66. simonwillison.net
John Tan
John Tan

Founder and CEO of nativefirst.ai. Embeds with scaling founders and CEOs to ship Level-3 agents and AI workflows in production.