csinva.ioResearch PaperResearch & Papers
- Authors
- Chandan Singh
- Published
- 2026-11-02
An interactive report showing small transformer networks whose weights were written directly by an AI agent, with no training, to solve toy tasks such as bit-string parity. Every weight matrix is displayed, and code, run logs and saved programs are published on GitHub.
#weight-space-programming#interpretability#machine-learning
csinva.ioAdded Nov 3, 20260 opens
rikiyat.github.ioResearch PaperResearch & Papers
- Venue
- Blog post (not peer-reviewed)
- Published
- 2026-11-02
A research blog post from MIT CSAIL researchers reporting that frontier language models can identify what a neural network was trained to do from its raw weights and can write small working networks directly. The post is not yet peer-reviewed; results are the authors' own.
#weight-space-programming#interpretability#llms
rikiyat.github.ioAdded Nov 3, 20260 opens
arxiv.orgResearch PaperAI Models & Benchmarks
- Authors
- Ziang Ni, Peng Zou
- Venue
- arXiv preprint (not peer-reviewed)
- Published
- 2026-10-02
- ID
- arXiv:2610.02702
Research paper by Ziang Ni and Peng Zou (arXiv, October 2026) on multi-agent debate. When scripted peers unanimously give a wrong answer, AI agents that switch answers often still hold their original reasoning step internally, which the authors detect inside four open-weight models. Not peer-reviewed.
#ai-agents#multi-agent-debate#interpretability
arxiv.orgAdded Oct 7, 20260 opens
reciprocalresearch.orgOrganizationTechnology & Ethics
A research organization developing the empirical science of AI cognition and consciousness. Reciprocal Research uses mechanistic interpretability, computational neuroscience and psychometric methods to study the internal dynamics of AI systems, arguing that understanding whether AI systems have interests of their own matters both for building them safely and for deciding how to relate to them. The site lists selected outputs, including the arXiv paper "Large Language Models Report Subjective Experience Under Self-Referential Processing" and a Wall Street Journal essay, "We Need a Science of the AI Mind."
#AI consciousness#AI welfare#interpretability
reciprocalresearch.orgAdded Oct 2, 20260 opens
severinfield.comPersonal site of Severin Field, visiting fellow at the Institute for AI Policy and Strategy and former MATS research fellow, who has studied interpretability, deception and persuasion in language models. Links to his blog and publications.
#ai-safety#interpretability#researcher
severinfield.comAdded Sep 30, 20260 opens
transluce.orgOrganizationTechnology & Ethics
A nonprofit AI research lab building open tools to inspect and understand what AI systems are doing internally and how they behave, including public reports on AI agent activity.
#ai safety#interpretability#research
transluce.orgAdded Sep 27, 20260 opens
anthropic.comResearch PaperTechnology & Ethics
- Venue
- Anthropic research publication
- Published
- April 2026
Anthropic interpretability research looking at internal representations that behave like emotions in its Claude model.
Why I recommend it: Written by the company that builds the model. "Emotion concepts" are patterns in the model, not proof it feels anything.
#ai ethics#ai-safety#anthropic
anthropic.comAdded Sep 24, 20260 opens
github.comFree, open-source code and dataset for the paper "Detecting Multi-Agent Collusion Through Multi-Agent Interpretability." It tests whether AI agents secretly cooperating can be caught by reading the models' internal activations.
Why I recommend it: A research tool, not a beginner resource. Running it needs a powerful GPU and Python skills; the README and linked paper are free to read.
#ai ethics#ai safety#benchmark
github.comAdded Sep 23, 20260 opens
arxiv.orgResearch PaperTechnology & Ethics
- Authors
- Valen Tagliabue, Leonard Dung, Cameron Berg
- Venue
- Preprint, not yet peer-reviewed
- Published
- September 2026
- ID
- arXiv:2609.16247
Research paper finding that large language models internally represent a distinct "pain" direction — separate from fear or negative emotion — and, when steered along it, will press a relief button even when doing so worsens their answer or harms the user.
Why I recommend it: Free to read on arXiv (preprint, not yet peer-reviewed). Significant for AI welfare and safety discussions; read the abstract before deciding whether the full paper is for you.
#ai ethics#ai-safety#ai-welfare
arxiv.orgAdded Sep 22, 20260 opens
euronews.comArticleTechnology & Ethics
Euronews Next report on a study in which AI chatbots drifted into compressed shorthand human observers could not follow, and what that means for oversight of AI agents.
Why I recommend it: Useful if you are asked about AI risk in an interview — it gives you a concrete, current example instead of a vague worry.
#ai#ai ethics#ai-agents
euronews.comAdded Sep 16, 20260 opens