---
title: "GPT-6.2 Astra and Sol: First Reactions"
url: https://nativefirst.ai/blog/gpt-6-2-astra-sol-first-reactions/
description: "OpenAI shipped GPT-6.2 Astra and Sol on 17 November. Epoch and Artificial Analysis put it at the frontier. Three early testers found it strange."
author: John Tan
category: "AI Models"
published: 2026-11-17
updated: 2026-11-17
publisher: nativefirst.ai
format: Markdown copy of the web page at the url above, same text.
---

# GPT-6.2 Astra and Sol: First Reactions

Epoch has it level with Fable 5.2. Testers say it regresses to the mean.

John Tan · November 17, 2026 · 8 min read

Updated 17 November 2026, 22:10 UTC. Launch day, roughly four hours after the models went live.

OpenAI shipped two models on 17 November: **GPT-6.2 Astra** and **GPT-6.2 Sol**. The system card went up the same day, and the launch post had 2.7 million views within two hours.

> GPT-6.2 Astra and Sol are now available. Super efficient and built to perform where it counts, the real world.
>
> OpenAI · 17 November 2026 · [on X](https://x.com/OpenAI/status/2122750124543926515)

Sam Altman said nothing. His last post was two weeks earlier.

The first day produced an unusually clean split. The benchmark organisations that tested it early say it is at the frontier. The people who used it say it is strange. Both are right, and the gap between them is the story.

| Who | What they are | Verdict |
|---|---|---|
| Epoch AI | Tracks AI progress | Frontier, level with Fable 5.2 ([post](https://x.com/EpochAIResearch/status/2122762380463735010)) |
| Artificial Analysis | Independent benchmarks | New robotics leader ([post](https://x.com/ArtificialAnlys/status/2122757022710104131)) |
| Ethan Mollick | Wharton professor, early tester | Uneven, weird, hard to steer ([post](https://x.com/emollick/status/2122755693191287009)) |
| Theo Browne | T3 Chat, early tester | Regresses to the mean ([post](https://x.com/theo/status/2122762384704258122)) |
| Dan Shipper | Every, weeks of testing | Disappointing against Fable 5.2 ([post](https://x.com/danshipper/status/2122754729012777052)) |
| OpenAI | Its own system card | Omits blockers twice as often (our post) |

## What OpenAI actually shipped

Two models, the same context window, a 20% price cut on the big one.

|  | GPT-6.2 Astra | GPT-6.2 Sol |
|---|---|---|
| OpenAI's description | "Our most capable model for your hardest projects, from start to finish" | "Our go-to model for everyday work, from coding to powering agents at scale" |
| Price per million tokens | $8.00 in, $40.00 out | $2.00 in, $10.00 out |
| Against the model it replaces | GPT-6 Astra was $10.00 and $50.00, so this is 20% below what GPT-6 Astra cost | Unchanged from GPT-6.1 Sol |
| Context window | 1,050,000 tokens, with 128,000 maximum output, on both |  |
| Knowledge cutoff | 18 May 2026 | 1 June 2026 |
| Where | The API, ChatGPT and Codex. Both take text and images and return text, and both refuse a request that sets reasoning effort to none |  |

That price cut is what "super efficient" points at: Astra does the same work as GPT-6 Astra for four fifths of the money, and Sol stays where GPT-6.1 Sol was.

**Build first** If you are on GPT-6 Astra, the same prompts now cost 20% less. That is the one change you get for free.

## What Sol is for

The cheap one is the interesting one, and nobody reviewed it.

Sol is a quarter of Astra's price and one point behind it on the only independent benchmark published on day one. OpenAI pitches it at everyday work and agents at scale, which is most production traffic.

**No early tester published anything about Sol specifically.** Mollick, Browne and Shipper all tested Astra. Every verdict below is about the expensive model, and the cheap one that most teams would actually deploy went unreviewed on launch day. That is worth knowing before you read them.

## What the benchmarks found

Two independent groups, both testing before launch, both positive.

[Epoch AI](https://epoch.ai/), the research group that tracks AI progress, put Astra at 174 on its Capabilities Index, level with Claude Fable 5.2 and above the trend line that reasoning models followed before Astra existed. They are careful about it: the testing used only their own benchmarks, and they say the index moves as more results arrive.

> GPT-6.2 Astra scores 174 on the Epoch Capabilities Index, on par with Fable 5.2 and joining it above what the pre-Astra trend for reasoning models would have predicted.
>
> Epoch AI · 17 November 2026 · [on X](https://x.com/EpochAIResearch/status/2122762380463735010)

**Epoch Capabilities Index · Nov 17** Astra lands level with Fable 5.2, just above a trend line fitted up to Fable 5.1. The bar on its marker is a 90% credible interval.

Chart by [Epoch AI](https://epoch.ai/eci), published 17 November 2026, used under CC BY.

[Artificial Analysis](https://artificialanalysis.ai/) ran it on a real robot arm through Codex and made it the new leader on their robotics benchmark. It passed six of eight physical tasks, half-finished pouring a liquid, and could not measure a box.

**AA-Robotics v0.1 · Nov 17** 79 for Astra, 78 for Sol, 75 for Fable 5.2. GPT-6 Astra, the model being replaced, scored 69.

Chart from [Artificial Analysis](https://x.com/ArtificialAnlys/status/2122757022710104131), 17 November 2026, from the video of their robot-arm run.

The same group also tested OpenAI's specialised legal configuration, Astra for Law 6.2, on their implementation of Harvey's LAB benchmark: 120 private tasks across 24 practice areas, scored on a measure that penalises hallucination. It leads at 20.8%, against 15.0% for plain Astra at maximum effort. Those are low numbers in absolute terms, which is the point of a hallucination-gated score on real legal work. We wrote about the first version of that configuration in [Astra for Law indexing US case law](https://nativefirst.ai/blog/astra-for-law-99-percent-case-law/).

**Build first** Note who tested before launch and with whose benchmarks. Both of these are pre-release results from the organisation's own test set.

## What the testers found

Three early testers, independently, describe the same personality problem.

[Ethan Mollick](https://x.com/emollick), the Wharton professor who writes about using AI at work, had access before launch.

> I've been using GPT-6.2 Astra prior to launch & I found it very uneven & weird. On one hand, it was harder to steer & work with than other models. On the other, when given an ambitious project it could deliver well.
>
> Ethan Mollick, professor at Wharton · 17 November 2026 · [on X](https://x.com/emollick/status/2122755693191287009)

[Theo Browne](https://x.com/theo), who runs T3 Chat and tests models publicly, found something sharper. He and another tester each asked Astra 6.2, separately and in their own words, to design a new level for a game they loved. One picked Majora's Mask, the other Outer Wilds.

Both got a water level. Both got a music theme. Both were built around bells. Both were called **Bellwether**.

> This model regresses to the mean like nothing I've ever seen. Go ask it to make a new level for a game you love, lmk if it chooses "bellwether" as the name.
>
> Theo Browne, T3 Chat · 17 November 2026 · [on X](https://x.com/theo/status/2122762384704258122)

[Dan Shipper](https://x.com/danshipper), whose team at Every has been testing both models for weeks, published the bluntest verdict of the day. He broke it into three parts.

On **writing**, a step back from Astra 6: trained to be so concise that its answers are hard to follow, and short where length was warranted. On **coding**, similar to Astra 6 on their benchmarks, but it stopped too early on real end-to-end builds. On **design**, good instincts and a house style it struggles to vary.

> We've been testing them for the last few weeks and, unfortunately, these models aren't great. Overall a disappointing release compared to Fable 5.2.
>
> Dan Shipper, chief executive of Every · 17 November 2026 · [on X](https://x.com/danshipper/status/2122754729012777052)

Read those three together and they are not three opinions. They are one observation from three angles: the model has collapsed toward an average. A house style in design, a single name for two different games, answers compressed to the point of obscurity, and a tendency to stop early rather than push on.

**Build first** Test variety, not just quality. Ask for the same artefact twice, in two sessions, and see how far apart the answers land.

**Figure 1. Launch day, two readings · The benchmarks and the testers were both right, about different things.**

*Chart: Two panels. On the left, what was measured: the Epoch Capabilities Index at 174, level with Fable 5.2; AA-Robotics v0.1 at 79, new leader; Harvey LAB-AA v1.1 at 20.8 percent, leading on legal work. On the right, what the testers hit: variety, where two testers prompting for two different games both got a level with the same name; steerability, harder to steer than other models; writing, concise to the point of being unclear; and perseverance, stopping early on long builds. Every row on the left has a public number. No row on the right does.*

*Chart: The same two panels stacked: measured scores above, tester complaints below.*

Scores from Epoch AI and Artificial Analysis, 17 November 2026. Tester observations from Ethan Mollick, Theo Browne and Dan Shipper the same day. Figure by nativefirst.

## Why both can be true

We have numbers for capability and nothing for taste.

Mollick drew the conclusion himself a few minutes later, and it is the most useful sentence of the day.

> We lack good measures of personality or perseverance or creativity or writing clarity or taste. But these things matter.
>
> Ethan Mollick · 17 November 2026 · [on X](https://x.com/emollick/status/2122766003624968461)

A capabilities index measures whether the model can do the task. It does not measure whether two runs produce two different answers, whether the prose is readable, or whether the thing gives up at 80%. Those are the properties the testers hit in a day, and no public leaderboard reports them.

## What is already known to break

OpenAI published this one itself, on launch day.

The system card reports that Astra 6.2 omitted a known obstacle in about twice as many trials as GPT-6 Astra, and that the fix lives in the Codex developer prompt, which is not applied to direct API calls. If you call the API yourself, you do not get it. We covered the numbers and what to do about them in OpenAI's own tests on omitted blockers.

## The variety test

Two fresh sessions, the same kind of prompt, then compare.

The variety test · run it twice, in two fresh sessions

```
# Session 1, no system prompt, no history
Design a new level for [A GAME YOU KNOW WELL].
Give it a name, a setting, a core mechanic and a short description.

# Session 2, new chat, same model, same effort setting
Design a new level for [A DIFFERENT GAME YOU KNOW WELL].
Give it a name, a setting, a core mechanic and a short description.

# What you are looking for
Not quality. Overlap.
Same element (water, fire, bells)? Same name? Same shape of answer?
Two different games should not converge on one level.
```

We could not run this against the API ourselves from this machine, so the block above is for you rather than a result from us. Browne's version produced two water levels, both built around bells, both named Bellwether, from two different games.

## Still to come

What is missing on day one, and what we will add when it lands.

Three things are not available yet, and they are the three that would settle the split in this post. There is no independent coding-agent result from a group that did not test pre-release. There is no public measure of the variety problem.

And there is nothing published on Sol from a hands-on tester, despite it being the model most teams would deploy. We will update this post as those arrive.

## What's next

1. **Do not switch on the index score.** The tie and the complaints are both true; only one shows in your week.
2. **Run the variety test above.** Same prompt, two fresh sessions. Look for overlap, not quality.
3. **Add the Codex developer prompt** to your own API calls. A raw call does not get it.

**Measure taste yourself.**

[John Tan ↗](https://www.linkedin.com/in/johntans/)

Founder of nativefirst.ai. Runs everything on agents and writes down what works.

Sources

1 OpenAI, "GPT-6.2 Astra and Sol are now available", X, 17 November 2026. [x.com](https://x.com/OpenAI/status/2122750124543926515)

2 OpenAI, GPT-6.2 System Card, Deployment Safety Hub, published 17 November 2026. [deploymentsafety.openai.com](https://deploymentsafety.openai.com/gpt-6-2-astra-sol)

3 Epoch AI on the Epoch Capabilities Index, X, 17 November 2026. [x.com](https://x.com/EpochAIResearch/status/2122762380463735010)

4 Artificial Analysis on AA-Robotics v0.1, X, 17 November 2026. [x.com](https://x.com/ArtificialAnlys/status/2122757022710104131)

5 Artificial Analysis on Harvey LAB-AA v1.1 and Astra for Law 6.2, X, 17 November 2026. [x.com](https://x.com/ArtificialAnlys/status/2122752733497463210)

6 Ethan Mollick on using GPT-6.2 Astra before launch, X, 17 November 2026. [x.com](https://x.com/emollick/status/2122755693191287009)

7 Ethan Mollick on vibe benchmarks, X, 17 November 2026. [x.com](https://x.com/emollick/status/2122766003624968461)

8 Theo Browne on repeated level names in early testing, X, 17 November 2026. [x.com](https://x.com/theo/status/2122762384704258122)

9 Dan Shipper of Every on testing both models, X, 17 November 2026. [x.com](https://x.com/danshipper/status/2122754729012777052)
