conv.

All stories
AIQuiet 12d · day 18

Ex-Anthropic researcher Coxon details his rift with the AI safety race

Jacob Coxon, whose resignation warning went viral, says Anthropic's 'someone will do it anyway' logic doesn't justify racing toward self-improving AI.

newest coverage 11d agosummary written 11d ago8 pieces NewswiresReddit

What to know

  • A single viral resignation post by 27-year-old researcher Jacob Coxon reignited the long-running AI-existential-risk debate, drawing 171 million views and reactions from staffers across major labs.
  • Anthropic CEO Dario Amodei publicly called the industry's pace 'reckless' days after the post, but no lab has paused development.
  • Coxon has since detailed his core disagreement with Anthropic leadership: that fear of losing an 'inevitable' race to recursive self-improvement is not a valid reason to keep building it.
  • Coverage now frames Coxon's warning within a decade-long pattern of AI doomsday alarms — from Stephen Hawking to Anthropic's own founders — that have shaken the industry without slowing its pursuit of more powerful systems.

Jacob Coxon Former OpenAI and Anthropic researcherEvan Hubinger Anthropic researcherDario AmodeiDario Amodei Anthropic CEOJakub PachockiJakub Pachocki OpenAI chief scientistLawrence Rosenberg AI-focused communications specialist

Ex-Anthropic researcher Coxon details his rift with the AI safety race
Business Insider

How it unfolded 5 developments, newest first · click a bar or a number to jump articlesposts

Peak 2 pieces in 5h at Sep 15, 2 AM; 8 pieces over 19 days (7 articles · 1 post) Sep 9, 11 AM — 1 piece · 1 article — Newswires 1Sep 9, 4 PM — quietSep 9, 9 PM — quietSep 10, 2 AM — quietSep 10, 7 AM — quietSep 10, 12 PM — quietSep 10, 5 PM — quietSep 10, 10 PM — quietSep 11, 3 AM — quietSep 11, 8 AM — quietSep 11, 1 PM — quietSep 11, 6 PM — quietSep 11, 11 PM — quietSep 12, 4 AM — quietSep 12, 9 AM — quietSep 12, 2 PM — quietSep 12, 7 PM — quietSep 13, 12 AM — quietSep 13, 5 AM — quietSep 13, 10 AM — quietSep 13, 3 PM — quietSep 13, 8 PM — quietSep 14, 1 AM — quietSep 14, 6 AM — quietSep 14, 11 AM — 1 piece · 1 article — Newswires 1Sep 14, 4 PM — quietSep 14, 9 PM — quietSep 15, 2 AM — 2 pieces · 2 articles — Newswires 2Sep 15, 7 AM — quietSep 15, 12 PM — 2 pieces · 2 articles — Newswires 2Sep 15, 5 PM — 1 piece · 1 post — Reddit 1Sep 15, 10 PM — quietSep 16, 3 AM — 1 piece · 1 article — Newswires 1Sep 16, 8 AM — quietSep 16, 1 PM — quietSep 16, 6 PM — quietSep 16, 11 PM — quietSep 17, 4 AM — quietSep 17, 9 AM — quietSep 17, 2 PM — quietSep 17, 7 PM — quietSep 18, 12 AM — quietSep 18, 5 AM — quietSep 18, 10 AM — quietSep 18, 3 PM — quietSep 18, 8 PM — quietSep 19, 1 AM — quietSep 19, 6 AM — quietSep 19, 11 AM — quietSep 19, 4 PM — quietSep 19, 9 PM — quietSep 20, 2 AM — quietSep 20, 7 AM — quietSep 20, 12 PM — quietSep 20, 5 PM — quietSep 20, 10 PM — quietSep 21, 3 AM — quietSep 21, 8 AM — quietSep 21, 1 PM — quietSep 21, 6 PM — quietSep 21, 11 PM — quietSep 22, 4 AM — quietSep 22, 9 AM — quietSep 22, 2 PM — quietSep 22, 7 PM — quietSep 23, 12 AM — quietSep 23, 5 AM — quietSep 23, 10 AM — quietSep 23, 3 PM — quietSep 23, 8 PM — quietSep 24, 1 AM — quietSep 24, 6 AM — quietSep 24, 11 AM — quietSep 24, 4 PM — quietSep 24, 9 PM — quietSep 25, 2 AM — quietSep 25, 7 AM — quietSep 25, 12 PM — quietSep 25, 5 PM — quietSep 25, 10 PM — quietYesterday, 3 AM — quietYesterday, 8 AM — quietYesterday, 1 PM — quietYesterday, 6 PM — quietYesterday, 11 PM — quietToday, 4 AM — quietToday, 9 AM — quietToday, 2 PM — quietToday, 7 PM — quiet ◂ 1 earlier2345
Sep 11Sep 13Sep 15Sep 17Sep 19Sep 21Sep 23Sep 25now · 11:44 PM ET
  1. 5

    Survey data resurfaces showing researchers long expected AI extinction risk

    A report cited a 2024 survey of more than 1,500 leading AI researchers in which the average estimated probability of an AI-driven extinction scenario was 18 percent, and noted other researchers, including OpenAI's Daniel Selsam and a former DeepMind researcher, have separately voiced similar warnings.

    1. 1 outlet Nearly one in five AI researchers already expected an extinction scenario from AI back in 2024

      first by The Decoder, 11d ago

  2. 4

    Coxon details specific disagreements with Anthropic leadership

    In a follow-up X session, Coxon elaborated on his dispute with Anthropic, saying leadership justified racing toward recursive self-improvement (RSI) partly on the belief that the race was inevitable, and argued that reasoning did not excuse participation.

    “They largely initiated the recent race to RSI, because of a belief in its inevitability.”
    — Jacob Coxon
    1. 1 outlet AI researcher whose apocalypse warning went viral outlines his disagreements with Anthropic leadership

      first by Business Insider, 12d ago

  3. 3

    Guardian frames Coxon's warning within decade of failed AI alarms

    The Guardian traced Coxon's resignation back through a decade of doomsday warnings from figures like Stephen Hawking, noting that such alarms have repeatedly shaken the AI industry without slowing its development.

    “racing straight to self-improving super intelligence and gambling with our lives.”
    — Jacob Coxon, Former Anthropic researcher · source
    1. 2 outlets Why a decade of doomsday warnings failed to slow the AI race

      first by Guardian Business, 12d ago · also Guardian Tech

  4. 2

    Recruiters frame Coxon's viral warning as a career opportunity

    Business Insider reported that recruiters and communications specialists view Coxon's viral resignation as a potential boon for future hiring, positioning him as a moral-conscience figure attractive to safety-focused employers.

    “Jacob Coxon has a personal brand built around moral conscientiousness.”
    — Lawrence Rosenberg
  5. background

    Amodei calls the industry's pace 'reckless', urges slowdown — Days after Coxon's resignation, Anthropic CEO Dario Amodei published a blog post responding to the backlash, describing the current AI race as reckless and reiterating risks including loss of control, cyberattacks and bioterrorism.

  6. 4 days quiet
  7. 1

    Coxon's post goes viral, echoed by dozens of AI staffers

    His original tweet drew more than 171 million views and was echoed by staffers across Anthropic, OpenAI and other AI firms, turning Coxon into a prominent public face of AI-risk warnings.

  8. background

    Anthropic's Evan Hubinger backs Coxon's fear, gives risk estimate — Anthropic researcher Evan Hubinger posted that Coxon was right that people building AI believe it could kill everyone, putting his own estimate at under 10 percent within a decade while saying Anthropic lacks a plan to solve superintelligence alignment.

  9. background

    Coxon resigns from Anthropic, warns AI could 'kill us all' — Jacob Coxon, who had worked at OpenAI and Anthropic, announced his resignation in a series of X posts, saying neither company was acting responsibly as they moved toward self-improving superintelligence.