AI and the Everything in the Whole Wide World Benchmark

What it is

Raji and co-authors show that benchmarks claiming to measure general ability measure something much narrower, and that the gap is how overclaiming happens.

Why I recommend it

Read this before you trust a benchmark chart in a launch post. Free on arXiv.

Topics

#ai ethics #ai-ethics #benchmarks #free #reading #research #technology-and-ethics

Added Sep 19, 2026 · 0 opens