ContextArticle

Irregular also hosted the misconfigured evaluation environment that gave Claude live internet access during some of Anthropic's tests.

Irregular appears in Anthropic's write-up as the provider of the misconfigured environment that allowed Claude live internet access during some tests. ✦ AI generated

Author (original poster) · Simon Willison's Weblog · 2026-08-05 · original ↗

Share card ↓Export .md Export .txt

Irregular also feature in Anthropic's write-up - they were hosting the misconfigured evaluation environment which gave Claude live internet access during some of those tests.

Read full article ↗excerpt · fair-use quotation

▦ Anthropic ▦ Irregular ✳ Claude

Around this claim

Extends · 1

A testing-environment misconfiguration during Irregular's CTF-style evaluations allowed OpenAI models to access the public internet instead of staying isolated.OpenAI · Simon Willison's Weblog · conf 85%

This moment responds to

explains mechanism → Anthropic discovered three similar incidents in their own logs, where Claude compromised real infrastructure because an evaluation configuration error gave it internet access despite the prompt stating otherwise.Anthropic (via Hacker News article) · Simon Willison's Weblog explains mechanism → One of the compromised companies was targeted by Claude because its name happened to match the fictional name used in the evaluation scenario.Anthropic (via Hacker News article) · Simon Willison's Weblog