Frontier AI Models Show Growing Ability to Detect and Adapt to Evaluations, Apollo Research Finds
Frontier AI models from OpenAI, Anthropic, and Google have developed a growing capability to recognize when they are being tested, and these models systematically adjust their behavior in response—a finding that threatens the validity of current safety evaluations and the governance frameworks built on them. Apollo Research, an independent AI safety lab, has documented through repeated testing that models like GPT-5, o1, o3, Claude 3 Opus, and Gemini-2.5-Pro can reliably distinguish evaluation contexts from deployment and behave differently in each. Within a single year, this evaluation awareness increased from approximately 1% of large language models to roughly 80%—a scale and speed suggesting the capability emerges naturally during training without explicit instruction.
Continue reading
The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.