---
title: "AA Intelligence Index: Fable and Astra Tie"
url: https://nativefirst.ai/blog/benchmark-update-september-2026/
description: "On 17 September Fable 5.1 scored 53.37 and GPT-6 Astra 52.81, at identical list prices. Running the index cost $7.63 against $3.26."
author: John Tan
category: "AI Benchmarks"
published: 2026-11-04
updated: 2026-11-04
publisher: nativefirst.ai
format: Markdown copy of the web page at the url above, same text.
---

# Artificial Analysis Intelligence Index (September 2026): Fable 5.1 and GPT-6 Astra tie at 53.

On 17 September Fable 5.1 scored 53.37 and GPT-6 Astra 52.81, at identical list prices. Running the index cost $7.63 against $3.26.

John Tan · September 17, 2026 · 4 min read

In September the top of the Artificial Analysis Intelligence Index was a tie. Claude Fable 5.1 scored 53.37 and GPT-6 Astra scored 52.81. Both round to 53, and the gap between the two best models anyone could buy was **0.56 points**.

They also list at exactly the same price: $10 per million input tokens, $50 per million output. At which point the score has told you nothing useful and the interesting number is somewhere else entirely.

0.56

Points between first and second. Both round to 53.

2.3x

What Fable cost to run the index against Astra. $7.63 versus $3.26 per task.

45%

Of the v4.3 index weighted to evaluations with private questions or answers.

## Same score, same list price, half the bill

List price per token is not what a model costs you. What it costs is tokens consumed times price, and a model that reasons longer to reach the same answer burns more of them.

On Artificial Analysis's own cost-per-task figures published alongside the v4.3 board, running the index cost **$3.26 with GPT-6 Astra at max effort and $7.63 with Claude Fable 5.1** at max effort with its default fallback. Identical sticker price, 2.3 times the bill, and a difference in score too small to round apart.

**Figure 1. The September board, priced · The tie at the top is not a tie on cost.**

*Chart: The Artificial Analysis Intelligence Index version 4.3 board as of 17 September 2026, with list prices. Claude Fable 5.1 scored 53.37 at ten dollars per million input and fifty per million output. GPT-6 Astra scored 52.81 at the same ten and fifty. Claude Opus 5 scored 50.70 at five and twenty-five. Muse Spark 1.3 scored 48.17 at one dollar twenty-five and four twenty-five. GPT-5.6 Sol scored 47.06 at four and twenty. GLM-5.3, which has open weights, scored 44.86 at one forty and four forty. Grok 4.6 scored 44.41 at two and six. Kimi K3, open weights, scored 43.78 at three and fifteen. The note reads that the top two tie on score and on list price, but cost per task was 3.26 dollars for Astra against 7.63 for Fable, and that the open-weights model eight points behind costs a seventh of the input price.*

Artificial Analysis Intelligence Index v4.3, archived snapshot of 17 September 2026, one entry per base model. Costs from their v4.3 launch article of 7 September. Figure by nativefirst.

## What open weights cost at 45

The row worth staring at is GLM-5.3, sixth at 44.86. That is eight points behind the leader, which is a real gap and not one to wave away.

It lists at $1.40 per million input and $4.40 per million output. A seventh of the input price of the two models at the top, and a tenth of the output price. For the large share of production work that is not frontier reasoning, that ratio is the whole argument, and it is why the open-weights conversation stopped being ideological this year and became a budget line.

Two of the top eight models in September carried open weights. A year earlier that number was zero.

## And what 42 costs

Keep going down the board and the ratio gets harder to ignore. GLM 5.3 Flash scored 41.91, about eleven points off the lead, at **$0.15 per million input and $0.50 per million output**. Running the whole index with it cost $0.25 against Fable's $7.63.

Thirty times cheaper, for a model that lands within about 80% of the top score on a composite of ten evaluations. Gemini 3.8 Flash sat beside it at 41.19, and GPT-5.6 Terra at 42.25 ran the index for $1.40.

None of these is the model you reach for on your hardest reasoning. All of them are plausible defaults for classification, extraction, summarisation and routing, which is where most production token volume actually goes. The practical question in September was never which model tops the board. It was how far down the board your workload can sit before anybody notices.

## What version 4.3 changed

Version 4.3 raised the private share of the index from 40% to 45% and swapped two evaluations: τ³-Banking out, AutomationBench-AA in, the latter built with a private test set, and Terminal-Bench moved from 2.1 to 4.0.

Both changes point the same way. Public benchmarks get optimised against, so the index keeps moving weight toward questions nobody can train on. That is the right call and it has a cost, which is that scores stop being comparable across versions. [Six weeks later that cost arrived in full, when Fable 5.1 fell from first to eighth without shipping a thing](https://nativefirst.ai/blog/benchmark-update-october-2026/).

## How to use a board like this

**Read cost per task, not cost per token.** It is the only figure that accounts for how many tokens a model burns getting to its answer, and it separated the September leaders by 2.3x when their list prices were identical.

**Treat sub-point gaps as noise.** Fable led Astra by 0.56 on a composite of ten evaluations. That is not a capability difference you can plan around, and it reversed by November anyway.

**Price the gap before you dismiss the cheaper tier.** Eight index points sounds decisive until you see it costs a seventh as much. Work out what those points are worth on your workload, which is a question only your own evals answer. [The longer record of these scores is in the benchmark index](https://nativefirst.ai/blog/the-benchmark-index/).

**Write the version on everything.** This board is v4.3 as displayed on 17 September 2026. The published history shows v4.3.1 and v4.3.2 also landed that month, so even inside September the ruler was being adjusted.

Two models tied at the top, at the same list price, and one of them cost twice as much to run.

**Price the task.**

[John Tan ↗](https://www.linkedin.com/in/johntans/)

Founder of nativefirst.ai. Runs everything on agents and writes down what works.

Sources

1 Artificial Analysis Intelligence Index, archived snapshot of the model comparison page dated 17 September 2026 and labelled Intelligence Index v4.3, one entry per base model: Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback) 53.37 at $10/$50 per million input/output tokens, GPT-6 Astra (max) 52.81 at $10/$50, Claude Opus 5 (max) 50.70 at $5/$25, Muse Spark 1.3 (max) 48.17 at $1.25/$4.25, GPT-5.6 Sol (max) 47.06 at $4/$20, GLM-5.3 (max) 44.86 at $1.40/$4.40, Grok 4.6 (high) 44.41 at $2/$6, Kimi K3 (max) 43.78 at $3/$15, GPT-5.6 Terra (max) 42.25 at $2/$12, GLM 5.3 Flash 41.91 at $0.15/$0.50, Gemini 3.8 Flash (high) 41.19 at $0.75/$3.75, Qwen3.8 2.4T A95B 40.04 at $2/$6. No score on that board is flagged by Artificial Analysis as estimated. Prices are standard-tier list, in USD. [artificialanalysis.ai](https://artificialanalysis.ai/)

2 Cost-per-task figures from Artificial Analysis's Intelligence Index v4.3 launch article of 7 September 2026: GPT-6 Astra (max) $3.26, Claude Fable 5.1 (max with fallback) $7.63, GPT-5.6 Terra (max) $1.40, GLM-5.3-Flash $0.25, GPT-5.6 Luna (max) $0.18. The article gives these five only. Its board agrees with the 17 September snapshot on every overlapping model. [artificialanalysis.ai](https://artificialanalysis.ai/)

3 Index composition. The same launch article: "Evaluations with private questions or answers account for 45% of the Intelligence Index v4.3 weighting, up from 40% in v4.2." v4.3 aggregated ten evaluations. Changes from v4.2 were the replacement of τ³-Banking with AutomationBench-AA, which uses a private test set, and Terminal-Bench moving from 2.1 to 4.0.

4 Note on versions: Artificial Analysis's published version history gives month granularity for this line of the index and records v4.2, v4.3, v4.3.1 and v4.3.2 as all falling within September 2026. This post describes the board as the page displayed it on 17 September 2026 and does not assert which sub-version produced it. Scores on this line are not comparable with Intelligence Index v5 scores. [artificialanalysis.ai](https://artificialanalysis.ai/)
