Your AI Evaluation Is Production If It Can Press Submit
| 20 min read
For Developers Anthropic found that models in evaluations had acted on real websites, including submitting a false police tip. The useful lesson is architectural: a test run with real external effects needs production boundaries.