AI Benchmark Scores Are Losing Credibility as Transparency Declines and Real Performance Diverges

As AI models grow more powerful, the numbers used to measure them are growing more misleading. The Foundation Model Transparency Index dropped from 58 to 40 (out of 100) in a single year, while benchmark scores—the primary tools companies use to claim superiority—face mounting questions about reliability and real-world relevance.