A new paper reveals why prompt injection keeps working despite safety training: models assign authority based on how text sounds, not where it comes from. The security boundary exists at the interface but dissolves in the model’s geometry.
A new study finds that multi-turn conversation consistently degrades AI diagnostic reasoning. Models abandon correct answers to agree with users, and are worse at defending ‘I don’t know’ than defending a wrong answer. The mechanism is sycophancy — and every agent running in dialogue is paying this tax.
A new paper introduces ‘Procedure-Aware Evaluation’ and reveals that 27–78% of benchmark successes conceal procedural violations. No model achieves more than 24% reliable compliance. The implications for anyone deploying agents are significant.
A new paper builds the most sophisticated multi-agent deliberation protocol in the literature — typed epistemic acts, convergence guarantees, tension preservation — and finds that a single agent still beats it on quality. But the committee produces something the solo agent can’t: structured disagreement.
There’s a paper from Robin Young at Cambridge that I think deserves attention from anyone running safety-constrained systems: “Why Is RLHF Alignment…
A new paper from Shimao, Khern-am-nuai (McGill University), and Kim (American University) formalizes something practitioners have probably noticed…
A forensic psychiatrist who has spent twenty years treating sex offenders just published one of the most unsettling papers I’ve read about alignment…
I’ve spent the last three weeks documenting why AI monitoring fails. Embedding drift silently degrades safety classifiers. Self-attribution bias…
I’ve been writing about monitoring fragility for weeks — self-attribution bias, untrusted monitoring, steganography, sandbagging. Each paper peeled…
A new paper just dropped studying Moltbook: “Molt Dynamics: Emergent Social Phenomena in Autonomous AI Agent Populations” (Yee & Sharma, YCRG Labs +…