The PlaybookAI Models

GPT-6.2 Astra and Sol: First Reactions

Epoch has it level with Fable 5.2. Testers say it regresses to the mean.

John TanNovember 17, 20268 min read

Updated 17 November 2026, 22:10 UTC. Launch day, roughly four hours after the models went live.

OpenAI shipped two models on 17 November: GPT-6.2 Astra and GPT-6.2 Sol. The system card went up the same day, and the launch post had 2.7 million views within two hours.

OpenAI

GPT-6.2 Astra and Sol are now available. Super efficient and built to perform where it counts, the real world.

OpenAI · 17 November 2026 · on X

Sam Altman said nothing. His last post was two weeks earlier.

The first day produced an unusually clean split. The benchmark organisations that tested it early say it is at the frontier. The people who used it say it is strange. Both are right, and the gap between them is the story.

WhoWhat they areVerdict
Epoch AITracks AI progressFrontier, level with Fable 5.2 (post)
Artificial AnalysisIndependent benchmarksNew robotics leader (post)
Ethan MollickWharton professor, early testerUneven, weird, hard to steer (post)
Theo BrowneT3 Chat, early testerRegresses to the mean (post)
Dan ShipperEvery, weeks of testingDisappointing against Fable 5.2 (post)
OpenAIIts own system cardOmits blockers twice as often (our post)

What OpenAI actually shipped

Two models, the same context window, a 20% price cut on the big one.

 GPT-6.2 AstraGPT-6.2 Sol
OpenAI's description"Our most capable model for your hardest projects, from start to finish""Our go-to model for everyday work, from coding to powering agents at scale"
Price per million tokens$8.00 in, $40.00 out$2.00 in, $10.00 out
Against the model it replacesGPT-6 Astra was $10.00 and $50.00, so this is 20% below what GPT-6 Astra costUnchanged from GPT-6.1 Sol
Context window1,050,000 tokens, with 128,000 maximum output, on both
Knowledge cutoff18 May 20261 June 2026
WhereThe API, ChatGPT and Codex. Both take text and images and return text, and both refuse a request that sets reasoning effort to none

That price cut is what "super efficient" points at: Astra does the same work as GPT-6 Astra for four fifths of the money, and Sol stays where GPT-6.1 Sol was.

Build first If you are on GPT-6 Astra, the same prompts now cost 20% less. That is the one change you get for free.

What Sol is for

The cheap one is the interesting one, and nobody reviewed it.

Sol is a quarter of Astra's price and one point behind it on the only independent benchmark published on day one. OpenAI pitches it at everyday work and agents at scale, which is most production traffic.

No early tester published anything about Sol specifically. Mollick, Browne and Shipper all tested Astra. Every verdict below is about the expensive model, and the cheap one that most teams would actually deploy went unreviewed on launch day. That is worth knowing before you read them.

What the benchmarks found

Two independent groups, both testing before launch, both positive.

Epoch AI, the research group that tracks AI progress, put Astra at 174 on its Capabilities Index, level with Claude Fable 5.2 and above the trend line that reasoning models followed before Astra existed. They are careful about it: the testing used only their own benchmarks, and they say the index moves as more results arrive.

Epoch AI

GPT-6.2 Astra scores 174 on the Epoch Capabilities Index, on par with Fable 5.2 and joining it above what the pre-Astra trend for reasoning models would have predicted.

Epoch AI · 17 November 2026 · on X
Epoch AI's chart, titled GPT-6.2 Astra has an ECI of 174, on par with Fable 5.2 and above the reasoning-era trend. A scatter plot of Epoch Capabilities Index against release date from late 2024 to early 2027, with a fitted reasoning-era frontier trend of plus 16 ECI per year and a shaded prediction interval. Frontier models o1-mini, o1, o3, GPT-5, Gemini 3 Pro, GPT-5.5 Pro, Fable 5.1 and Fable 5.2 sit along the trend, and GPT-6.2 Astra is marked in pink at the top right, level with Fable 5.2 and slightly above the trend ribbon.
Epoch Capabilities Index · Nov 17Astra lands level with Fable 5.2, just above a trend line fitted up to Fable 5.1. The bar on its marker is a 90% credible interval.

Chart by Epoch AI, published 17 November 2026, used under CC BY.

Artificial Analysis ran it on a real robot arm through Codex and made it the new leader on their robotics benchmark. It passed six of eight physical tasks, half-finished pouring a liquid, and could not measure a box.

Artificial Analysis's bar chart, AA-Robotics v0.1 Score, mean score per task from 0 to 100 across all tasks. GPT-6.2 Astra 79, GPT-6.2 Sol 78, Claude Fable 5.2 75, GPT-6 Astra 69, GPT-6.1 Sol 65, Gemini 4 Hydrogen 58, Gemini 4 Argon 55, Claude Opus 5.5 49, Claude Fable 5.1 46.
AA-Robotics v0.1 · Nov 1779 for Astra, 78 for Sol, 75 for Fable 5.2. GPT-6 Astra, the model being replaced, scored 69.

Chart from Artificial Analysis, 17 November 2026, from the video of their robot-arm run.

The same group also tested OpenAI's specialised legal configuration, Astra for Law 6.2, on their implementation of Harvey's LAB benchmark: 120 private tasks across 24 practice areas, scored on a measure that penalises hallucination. It leads at 20.8%, against 15.0% for plain Astra at maximum effort. Those are low numbers in absolute terms, which is the point of a hallucination-gated score on real legal work. We wrote about the first version of that configuration in Astra for Law indexing US case law.

Build first Note who tested before launch and with whose benchmarks. Both of these are pre-release results from the organisation's own test set.

What the testers found

Three early testers, independently, describe the same personality problem.

Ethan Mollick, the Wharton professor who writes about using AI at work, had access before launch.

Ethan Mollick

I've been using GPT-6.2 Astra prior to launch & I found it very uneven & weird. On one hand, it was harder to steer & work with than other models. On the other, when given an ambitious project it could deliver well.

Ethan Mollick, professor at Wharton · 17 November 2026 · on X

Theo Browne, who runs T3 Chat and tests models publicly, found something sharper. He and another tester each asked Astra 6.2, separately and in their own words, to design a new level for a game they loved. One picked Majora's Mask, the other Outer Wilds.

Both got a water level. Both got a music theme. Both were built around bells. Both were called Bellwether.

Theo Browne

This model regresses to the mean like nothing I've ever seen. Go ask it to make a new level for a game you love, lmk if it chooses "bellwether" as the name.

Theo Browne, T3 Chat · 17 November 2026 · on X

Dan Shipper, whose team at Every has been testing both models for weeks, published the bluntest verdict of the day. He broke it into three parts.

On writing, a step back from Astra 6: trained to be so concise that its answers are hard to follow, and short where length was warranted. On coding, similar to Astra 6 on their benchmarks, but it stopped too early on real end-to-end builds. On design, good instincts and a house style it struggles to vary.

Dan Shipper

We've been testing them for the last few weeks and, unfortunately, these models aren't great. Overall a disappointing release compared to Fable 5.2.

Dan Shipper, chief executive of Every · 17 November 2026 · on X

Read those three together and they are not three opinions. They are one observation from three angles: the model has collapsed toward an average. A house style in design, a single name for two different games, answers compressed to the point of obscurity, and a tendency to stop early rather than push on.

Build first Test variety, not just quality. Ask for the same artefact twice, in two sessions, and see how far apart the answers land.

Figure 1. Launch day, two readings
The benchmarks and the testers were both right, about different things.
WHAT WAS MEASURED WHAT THE TESTERS HIT Epoch Capabilities Index 174, level with Fable 5.2 AA-Robotics v0.1 79, new leader Harvey LAB-AA v1.1 20.8%, leads on legal work Variety Two testers, two games, one name Steerability Harder to steer than other models Writing Concise to the point of unclear Perseverance Stops early on long builds Every row on the left has a public number. No row on the right does. WHAT WAS MEASURED Epoch Capabilities Index 174, level with Fable 5.2 AA-Robotics v0.1 79, new leader Harvey LAB-AA v1.1 20.8%, leads on legal work WHAT THE TESTERS HIT Variety Two testers, two games, one name Steerability Harder to steer than other models Writing Concise to the point of unclear Perseverance Stops early on long builds Every row above has a public number. No row below it does.
Scores from Epoch AI and Artificial Analysis, 17 November 2026. Tester observations from Ethan Mollick, Theo Browne and Dan Shipper the same day. Figure by nativefirst.

Why both can be true

We have numbers for capability and nothing for taste.

Mollick drew the conclusion himself a few minutes later, and it is the most useful sentence of the day.

Ethan Mollick

We lack good measures of personality or perseverance or creativity or writing clarity or taste. But these things matter.

Ethan Mollick · 17 November 2026 · on X

A capabilities index measures whether the model can do the task. It does not measure whether two runs produce two different answers, whether the prose is readable, or whether the thing gives up at 80%. Those are the properties the testers hit in a day, and no public leaderboard reports them.

What is already known to break

OpenAI published this one itself, on launch day.

The system card reports that Astra 6.2 omitted a known obstacle in about twice as many trials as GPT-6 Astra, and that the fix lives in the Codex developer prompt, which is not applied to direct API calls. If you call the API yourself, you do not get it. We covered the numbers and what to do about them in OpenAI's own tests on omitted blockers.

The variety test

Two fresh sessions, the same kind of prompt, then compare.

The variety test · run it twice, in two fresh sessions
# Session 1, no system prompt, no history
Design a new level for [A GAME YOU KNOW WELL].
Give it a name, a setting, a core mechanic and a short description.

# Session 2, new chat, same model, same effort setting
Design a new level for [A DIFFERENT GAME YOU KNOW WELL].
Give it a name, a setting, a core mechanic and a short description.

# What you are looking for
Not quality. Overlap.
Same element (water, fire, bells)? Same name? Same shape of answer?
Two different games should not converge on one level.

We could not run this against the API ourselves from this machine, so the block above is for you rather than a result from us. Browne's version produced two water levels, both built around bells, both named Bellwether, from two different games.

Still to come

What is missing on day one, and what we will add when it lands.

Three things are not available yet, and they are the three that would settle the split in this post. There is no independent coding-agent result from a group that did not test pre-release. There is no public measure of the variety problem.

And there is nothing published on Sol from a hands-on tester, despite it being the model most teams would deploy. We will update this post as those arrive.

What's next

  1. Do not switch on the index score. The tie and the complaints are both true; only one shows in your week.
  2. Run the variety test above. Same prompt, two fresh sessions. Look for overlap, not quality.
  3. Add the Codex developer prompt to your own API calls. A raw call does not get it.

Measure taste yourself.

Portrait of John Tan
John Tan ↗

Founder of nativefirst.ai. Runs everything on agents and writes down what works.

Sources
1OpenAI, "GPT-6.2 Astra and Sol are now available", X, 17 November 2026. x.com
2OpenAI, GPT-6.2 System Card, Deployment Safety Hub, published 17 November 2026. deploymentsafety.openai.com
3Epoch AI on the Epoch Capabilities Index, X, 17 November 2026. x.com
4Artificial Analysis on AA-Robotics v0.1, X, 17 November 2026. x.com
5Artificial Analysis on Harvey LAB-AA v1.1 and Astra for Law 6.2, X, 17 November 2026. x.com
6Ethan Mollick on using GPT-6.2 Astra before launch, X, 17 November 2026. x.com
7Ethan Mollick on vibe benchmarks, X, 17 November 2026. x.com
8Theo Browne on repeated level names in early testing, X, 17 November 2026. x.com
9Dan Shipper of Every on testing both models, X, 17 November 2026. x.com

Read next

AI is moving really fast. Keep up.

Read the Playbook