Skip to content

root / tags / swe-bench-pro

#SWE-Bench Pro

2 fiches

Economy & Market Auto-verified translation

GPT-5.6 Sol, Terra, Luna : comment OpenAI rebat les cartes du coding agentique et du pricing

SFEIR analysis (firm's voice) of the general availability, on July 9, 2026, of **GPT-5.6** by OpenAI — not a single model but a **family of three tiers**: **Sol** (long-horizon/cyber/science flagship, the only one to unlock the "max" and "ultra" modes), **Terra** (everyday balanced tier, ~half the price of GPT-5.5), and **Luna** (fast/economical, high volume). All three share ~**1.05M tokens** of context, **128k** output tokens, and a knowledge cutoff of **February 16, 2026**. The most structuring fact is not a score but an **aggressive pricing grid** (Sol $5/$30, Terra $2.50/$15, Luna $1/$6 per million tokens): Sol keeps the previous flagship's price while being more capable, forcing the comparison onto the **capability-to-cost ratio**. Two billing subtleties (cache writes billed at **1.25×**, a surcharge beyond **272k** tokens) make the grid misleading until one has measured how much context the agent re-reads (read/write ratio ~**153:1** in agentic coding). Engineer's verdict, claimed to be neutral (SFEIR is both a **Google Cloud Premier** partner *and* an **Anthropic** partner): **no one sweeps every table** — GPT-5.6 dominates Terminal-Bench 2.1 and the Coding Agent Index (at a third of the cost per task), Claude stays ahead on SWE-Bench Pro (~15 pts); METR flagged a record **reward hacking** rate on Sol. Conclusion: "stop looking for the champion, learn to route" — the model is a commodity, the durable advantage lies in **Context/Harness Engineering**.

#GPT-5.6#Sol#Terra

SFEIR (voix éditoriale du cabinet)

AI Coding Agents & Skills Auto-verified translation

The Batch n°350 — How Coding Agents Accelerate Different Types of Software Work (Andrew Ng) + GLM-5.1, Digit chez Schaeffler, anti-data-center revolt, assistant axis

Andrew Ng's editorial in The Batch #350 sets out an **acceleration hierarchy for coding agents** by type of software work: **Frontend (max) > Backend (moderate) > Infrastructure (low) > Research (minimal)**. The rationale rests on implicit *verifiability* (fluency in TypeScript/JavaScript plus an autonomous agent–browser test loop on the frontend) and on the LLMs' blind spots (corner cases / security / DB migrations for backend, opaque network tradeoffs for infra, irreducible hypothesis formation for research). The issue is rounded out by 4 structuring news items: **GLM-5.1 (Z.ai)**, a 754B/40B-active-parameter MIT-licensed model capable of autonomous tasks lasting 8 hours (SWE-Bench Pro leader at 58.4%); **Digit (Agility Robotics) at Schaeffler**, the first industrial deployment of humanoids (5'9"/143lb, $10–25/h vs $20/h for a human); the **anti-data-center revolt** (~$64B blocked May 2024 – March 2025, Maine moratorium on 20MW+ facilities, molotov cocktail at Sam Altman's home); and the **"assistant axis"** (Christina Lu, MATS / Oxford / Anthropic), which reduces persona drift and jailbreaks (Qwen3 32B: 83%→41%; Llama 3.3 70B: 65%→33%) without degrading IFEval/GSM8k/MMLU-Pro/EQ-Bench.

#Andrew Ng#The Batch#DeepLearning.AI

Andrew Ng (édito principal — fondateur DeepLearning.AI, Stanford, ex-Google Brain, ex-Baidu) ; rédaction The Batch (DeepLearning.AI) pour les sections actualités