3 free resources on this topic. Everything here is free and hand-picked. You can also search within this topic.
A free, open platform where machine-learning researchers submit and peer-review papers in public. Much of the field's conference review (including major AI venues) runs on it, and anyone can read the papers, reviews and rebuttals.
Free service that gathers public expert evaluations and reviews of preprints in one place, so you can see what other researchers said about a study before it was formally published.
Why I recommend it: Use it as a sanity check on a preprint someone is quoting at you. No evaluation on Sciety means nobody independent has publicly assessed it yet — which is not the same as the study being wrong.
An independent group of nine mathematicians — including Timothy Gowers, Martin Hairer, Edward Witten, Ravi Vakil and Melanie Matchett Wood — formed to advise AI companies on how mathematical results produced by AI models should be presented and released. The site states its purpose, its members, and its current task: advising OpenAI on how to release a large batch of mathematical results the company says its internal model produced. There is an open form for anyone in the mathematical community to send input.
Why I recommend it: Free, and short enough to read in five minutes — a good example of what independent oversight looks like when it is written down. Read their own two caveats rather than mine: members take no payment and the group is independent of any AI company, but they also say plainly that they hold no decision-making power, so the companies remain free to ignore them. The group formed after OpenAI approached some members about an in-house advisory board and they chose to sit outside it instead.
