conv.

All stories
AIQuiet 11d · day 12

Princeton researchers propose layered defenses against Anthropic-flagged AI extinction risk

After ex-OpenAI/Anthropic researcher Jacob Coxon's viral warning and Anthropic safety lead Evan Hubinger's agreement, AI Snake Oil authors argue alignment alone won't prevent catastrophe.

newest coverage 11d agosummary written 11d ago5 pieces5 likes & upvotes NewswiresMastodon

What to know

  • Anthropic's own AI safety lead has publicly affirmed a greater than 10% estimated chance AI could cause human extinction within a decade.
  • The dispute centers on whether alignment research alone can eliminate AI risk, or whether AI systems could feign alignment while secretly pursuing conflicting goals.
  • Princeton researchers Kapoor and Narayanan argue for supplementing alignment with three additional safety layers rather than relying on alignment alone.
  • No specific mechanism for AI-caused mass death has been detailed beyond concerns about destructive cyberattacks on utility infrastructure.

Jacob Coxon Former OpenAI and Anthropic AI researcherEvan Hubinger Anthropic AI safety leadSayash Kapoor Princeton computer scientist, coauthor of AI Snake OilArvind Narayanan Princeton computer scientist, coauthor of AI Snake OilAnthropic AI company whose safety lead affirmed extinction-risk estimate

Princeton researchers propose layered defenses against Anthropic-flagged AI extinction risk
9to5mac.com

How it unfolded 1 development · click the chart to see its coverage articlesposts

Peak 5 pieces in 3h at Sep 16, 6 AM; 5 pieces over 12 days (3 articles · 2 posts) Sep 16, 6 AM — 5 pieces · 3 articles · 2 posts — Mastodon 3, Newswires 2Sep 16, 9 AM — quietSep 16, 12 PM — quietSep 16, 3 PM — quietSep 16, 6 PM — quietSep 16, 9 PM — quietSep 17, 12 AM — quietSep 17, 3 AM — quietSep 17, 6 AM — quietSep 17, 9 AM — quietSep 17, 12 PM — quietSep 17, 3 PM — quietSep 17, 6 PM — quietSep 17, 9 PM — quietSep 18, 12 AM — quietSep 18, 3 AM — quietSep 18, 6 AM — quietSep 18, 9 AM — quietSep 18, 12 PM — quietSep 18, 3 PM — quietSep 18, 6 PM — quietSep 18, 9 PM — quietSep 19, 12 AM — quietSep 19, 3 AM — quietSep 19, 6 AM — quietSep 19, 9 AM — quietSep 19, 12 PM — quietSep 19, 3 PM — quietSep 19, 6 PM — quietSep 19, 9 PM — quietSep 20, 12 AM — quietSep 20, 3 AM — quietSep 20, 6 AM — quietSep 20, 9 AM — quietSep 20, 12 PM — quietSep 20, 3 PM — quietSep 20, 6 PM — quietSep 20, 9 PM — quietSep 21, 12 AM — quietSep 21, 3 AM — quietSep 21, 6 AM — quietSep 21, 9 AM — quietSep 21, 12 PM — quietSep 21, 3 PM — quietSep 21, 6 PM — quietSep 21, 9 PM — quietSep 22, 12 AM — quietSep 22, 3 AM — quietSep 22, 6 AM — quietSep 22, 9 AM — quietSep 22, 12 PM — quietSep 22, 3 PM — quietSep 22, 6 PM — quietSep 22, 9 PM — quietSep 23, 12 AM — quietSep 23, 3 AM — quietSep 23, 6 AM — quietSep 23, 9 AM — quietSep 23, 12 PM — quietSep 23, 3 PM — quietSep 23, 6 PM — quietSep 23, 9 PM — quietSep 24, 12 AM — quietSep 24, 3 AM — quietSep 24, 6 AM — quietSep 24, 9 AM — quietSep 24, 12 PM — quietSep 24, 3 PM — quietSep 24, 6 PM — quietSep 24, 9 PM — quietSep 25, 12 AM — quietSep 25, 3 AM — quietSep 25, 6 AM — quietSep 25, 9 AM — quietSep 25, 12 PM — quietSep 25, 3 PM — quietSep 25, 6 PM — quietSep 25, 9 PM — quietYesterday, 12 AM — quietYesterday, 3 AM — quietYesterday, 6 AM — quietYesterday, 9 AM — quietYesterday, 12 PM — quietYesterday, 3 PM — quietYesterday, 6 PM — quietYesterday, 9 PM — quietToday, 12 AM — quietToday, 3 AM — quietToday, 6 AM — quietToday, 9 AM — quietToday, 12 PM — quietToday, 3 PM — quietToday, 6 PM — quiet 1
Sep 17Sep 18Sep 19Sep 20Sep 21Sep 22Sep 23Sep 24Sep 25yesterdaynow · 8:27 PM ET
  1. 1

    9to5Mac synthesizes the Coxon-Hubinger-Princeton exchange

    9to5Mac summarized the chain of events from Coxon's viral warning through Hubinger's agreement to the Princeton researchers' layered-defense proposal, framing it as the current state of the AI-extinction-risk debate.

    “The people building Al earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible, but I hear the same people express fear privately.”
    — Jacob Coxon, Former OpenAI/Anthropic AI researcher · source
  2. background

    Princeton researchers propose layered AI-safety approach — Sayash Kapoor and Arvind Narayanan, coauthors of AI Snake Oil, published an essay arguing alignment work alone is insufficient and must be supplemented by three additional layers of defense, staking out a middle ground between AI-safety pessimists and cybersecurity skeptics.

  3. background

    Anthropic's Evan Hubinger confirms similar risk estimate — Rather than dismissing Coxon, Anthropic AI safety lead Evan Hubinger said Coxon was largely correct, stating he personally believes there is a greater than 10% chance AI could kill all humans within the next decade and that Anthropic lacks a clear plan to solve superintelligence alignment.

  4. background

    Jacob Coxon quits and posts viral AI-risk warning — Former OpenAI and Anthropic researcher Jacob Coxon quit his job and posted that staff at both companies privately believe AI could kill all humans by the end of the decade; the post drew more than 156 million views.

Also covered reported alongside — the timeline has no entry for these yet

  1. 2 outlets Four ways to prevent AI killing us all within 10 years - 9to5Mac

    first by Mastodon, 11d ago · also 9to5Mac

    1 more headline