Can AI Spot Mistakes in IKEA Assembly?

What it is

Epoch AI report on a spatial reasoning benchmark built around finding mistakes in photos of partially assembled IKEA furniture — a proxy for economically important visual reasoning tasks like repair work. Top scores jumped from 28% to 80% in 10 months; Chinese open-weight models trail the frontier by about 7 months.

Topics