Contents
Tags

Most of the GPT-6 Astra coverage went to the AGI argument. The more consequential number got a paragraph: Astra scored 100% on ExploitBench and is the first model OpenAI classes as crossing its Critical threshold for cyber capability.
That is not a marketing figure. It is a company publishing that its own product can find previously unknown vulnerabilities and build working exploits.
OpenAI's preparedness framework defines capability thresholds with required safeguards attached. Crossing into Critical is the company saying a model has reached a level where the downside case is severe enough to need specific mitigations rather than general ones. This is the first time that threshold has been crossed on cyber.
The same disclosure reports that Astra's reasoning is harder to read than its predecessor's, that chain-of-thought monitoring is fragile, and that the trend is in a negative direction.
A model that is simultaneously more capable at finding exploits and less legible to its own monitoring is precisely the combination safety researchers have been describing for years. It arrived quietly, in a paragraph, during a week everyone spent arguing about a benchmark score.
Vendor safety disclosures are one of the few places where a company publishes something against its own commercial interest. When a lab reports that its monitoring is fragile and trending the wrong way, that is more informative than any benchmark in the same announcement.
As with the AGI claim, none of this is independently reproduced. Everything here is the vendor's own report of its own model — worth taking seriously, and worth labelling.
Frontier labs publish frameworks that define capability levels with required safeguards attached. They are not marketing documents — they are commitments that constrain what the company may ship, and crossing a level triggers obligations rather than a press release.
That makes them one of the few places a lab publishes something against its own commercial interest, which is exactly why they repay careful reading.
A high benchmark score on offensive capability is expected as models improve. The genuinely new information is the admission that chain-of-thought monitoring is fragile and trending in the wrong direction.
Monitoring is what makes a capable model governable. A model that is more capable and harder to observe at the same time removes the mitigation exactly when the mitigation is most needed. That combination, not the ExploitBench number, is the part worth watching over the next few releases.
For local models specifically, nothing changes. Open-weight models at sizes you can run at home are nowhere near this capability level, and the gap is measured in orders of magnitude of parameters rather than in months.
It means the capability exists and the lab says so. Access controls, refusal training and monitoring are what stand between capability and misuse, and the same disclosure says one of those three is weakening.
Not at current sizes. A model you can run on a consumer card is not close to this. The question becomes real if capability at this level ever appears in open weights, which it has not.
It is a benchmark, with the usual caveats — a score of 100% says the test has been saturated, which tells you as much about the test's remaining headroom as about the model.
The other number from launch week, and why it does not mean AGI.
Read the benchmark analysis →Tools
Find AI models that fit your exact hardware. Enter your specs and get a ranked list instantly.
Newsletter