Jacob Coxon
Former pretraining researcher at OpenAI and Anthropic
British AI researcher who worked on model pretraining at OpenAI and then Anthropic. He resigned from Anthropic on Sept. 8, 2026, posting that neither company was acting responsibly and that they were "gambling with our lives" by racing toward self-improving superintelligence.
Key arguments & positions
- Argues frontier labs are racing toward self-improving superintelligence without adequate control, and that neither OpenAI nor Anthropic is acting responsibly.
- Has said today's AI tools are safe for everyday use; his concern is where the pace of capability gains leads.
Accomplishments
- Pretraining researcher at OpenAI (from 2023, including work on GPT-4o) and Anthropic (from 2024).
- Represented the U.K. at the International Mathematical Olympiad in 2016 and 2017; studied mathematics at Cambridge.
Papers & key writings
His views appear in his Sept. 8, 2026 resignation post on X and in interviews, not long-form writing.
Links
In the library
Nothing of theirs is filed in the hub yet. Browse the full library.
Recommended next
Hand-picked from the hub based on what Jacob Coxon covers.
AI Risk, Plainly
Plain-language explanations of AI safety concepts, including scheming, evaluation awareness, chain-of-thought monitoring, catastrophic risk and power concentration. Each entry describes the idea, its role in risk arguments and research evidence.
Why this: Covers AI safety and AI risk too
Gradual Disempowerment
Research project and paper examining how incremental automation of economic, cultural, and political systems could erode human influence even without a sudden AI takeover.
Why this: Covers AI safety and AI risk too
AGI Ruin: A List of Lethalities
Essay by Eliezer Yudkowsky on the LessWrong forum presenting a list of failure modes through which a misaligned advanced AI could lead to human extinction, framed as claims the author argues are not being addressed. The page includes the posting date and extensive community discussion in the comments.
Why this: Covers AI safety and AI risk too
PyRIT
Microsoft's open-source toolkit for red-teaming AI systems: automated attack prompts, scoring of the responses, and repeatable runs. Free.
Why this: Covers AI safety and AI risk too