conv.

All stories
AIQuiet 4d · day 5

Hinton warns AI could trigger major infrastructure incident within a year

The neural network pioneer says it might have been better never to develop AI and criticizes tech leaders for prioritizing profit over safety.

What to know

  • Hinton, a Nobel laureate who pioneered neural networks, predicted AI could trigger a major infrastructure incident like a power grid or financial system blackout within a year, explicitly saying it might have been better if AI had never been developed.
  • He accused OpenAI's Sam Altman, Mark Zuckerberg, and Elon Musk of understanding AI risks but choosing profit over safety, saying they 'don't give a shit' about the consequences of advancing powerful models.
  • Hinton framed the issue as a decade-long test: within ten years, humanity will either successfully manage AI risks and achieve abundance, or fail and face mass unemployment, inequality, and social collapse.
  • The 78-year-old left Google in 2023 specifically to speak freely about AI dangers, and is now using his reputation to warn the public before it's too late.

The dispute Whether AI development's risks could have been meaningfully mitigated by corporate caution versus whether the technology was inherently going to be developed and deployed at scale regardless of any individual company's choices. · positions read across 51 posts and comments

many voices

Tech leaders knowingly prioritize profit over safety despite understanding the risks.

  • “If the people in charge of the AI companies understand the risk I don't know, but I think it's a good point that they mainly care about the money.”

    mrweasel · Hacker News ↗
many voices

AI development was inevitable and unstoppable regardless of corporate choices or caution.

  • “The AI formula is out of the bag. The Manhattan Project is over, trinity has happened. If it weren't OAI and Anthropic, it would be others.”

    sneak · Hacker News ↗
some voices

A major catastrophic incident might be necessary to force society to take AI risks seriously.

  • “I know this sounds unusual, but I do think this wouldn't be the worst thing that could happen…it might also make us think twice about continuing down our current path…human beings in a large mass only respond to one thing: immediate…”

    bemtevi · Hacker News ↗
some voices

Hinton's specific warnings about infrastructure attacks are not credible; the real problem is poor security engineering.

  • “I don't buy this. There isn't some kind of voodoo "rogue AI(s)" out there which could randomly decide to take over their vendor stack…Why are power systems internet connected?”

    gkcnlr · Hacker News ↗

Geoffrey HintonGeoffrey Hinton Neural network pioneer, Nobel laureateSam AltmanSam Altman OpenAI CEOMark ZuckerbergMark Zuckerberg Tech company leaderElon MuskElon Musk Tech company leader

Hinton warns AI could trigger major infrastructure incident within a year
theguardian.com

How it unfolded 2 developments, newest first · click a bar or a number to jump articlespostscomments

Peak 16 pieces in two hours at Nov 4, 6 AM; 66 pieces over 5 days (7 articles · 16 posts · 43 comments) Nov 3, 4 PM — 9 pieces · 5 articles · 3 posts · 1 comment — Newswires 3, Mastodon 2, Reddit 2, +2 moreNov 3, 6 PM — 3 pieces · 3 posts — Mastodon 2, Hacker News 1Nov 3, 8 PM — 2 pieces · 1 post · 1 comment — Reddit 1, Bluesky 1Nov 3, 10 PM — quietNov 4, 12 AM — quietNov 4, 2 AM — 1 piece · 1 post — Bluesky 1Nov 4, 4 AM — 7 pieces · 2 articles · 4 posts · 1 comment — Mastodon 2, Newswires 2, Bluesky 1, +2 moreNov 4, 6 AM — 16 pieces · 1 post · 15 comments — Hacker News 15, Mastodon 1Nov 4, 8 AM — 13 pieces · 13 comments — Hacker News 13Nov 4, 10 AM — 6 pieces · 6 comments — Hacker News 6Nov 4, 12 PM — 2 pieces · 2 comments — Hacker News 2Nov 4, 2 PM — 1 piece · 1 comment — Hacker News 1Nov 4, 4 PM — 1 piece · 1 comment — Hacker News 1Nov 4, 6 PM — quietNov 4, 8 PM — quietNov 4, 10 PM — 1 piece · 1 comment — Hacker News 1Nov 5, 12 AM — quietNov 5, 2 AM — 1 piece · 1 post — Mastodon 1Nov 5, 4 AM — quietNov 5, 6 AM — 1 piece · 1 post — Mastodon 1Nov 5, 8 AM — quietNov 5, 10 AM — quietNov 5, 12 PM — quietNov 5, 2 PM — quietNov 5, 4 PM — quietNov 5, 6 PM — 1 piece · 1 post — Bluesky 1Nov 5, 8 PM — quietNov 5, 10 PM — quietNov 6, 12 AM — quietNov 6, 2 AM — quietNov 6, 4 AM — quietNov 6, 6 AM — 1 piece · 1 comment — Hacker News 1Nov 6, 8 AM — quietNov 6, 10 AM — quietNov 6, 12 PM — quietNov 6, 2 PM — quietNov 6, 4 PM — quietNov 6, 6 PM — quietNov 6, 8 PM — quietNov 6, 10 PM — quietYesterday, 12 AM — quietYesterday, 2 AM — quietYesterday, 4 AM — quietYesterday, 6 AM — quietYesterday, 8 AM — quietYesterday, 10 AM — quietYesterday, 12 PM — quietYesterday, 2 PM — quietYesterday, 4 PM — quietYesterday, 6 PM — quietYesterday, 8 PM — quietYesterday, 10 PM — quietToday, 12 AM — quietToday, 2 AM — quietToday, 4 AM — quietToday, 6 AM — quietToday, 8 AM — quietToday, 10 AM — quietToday, 12 PM — quiet 12
Nov 4Nov 5Nov 6yesterdaynow · 1:09 PM ET
  1. 2

    Hinton's warnings gain traction on Hacker News

    The Guardian article about Hinton's warnings reached 320 points and 316 comments on Hacker News, becoming a focal point for discussion about AI risks and corporate leadership accountability.

    “it might be that we would have been better off never developing it…”
    — Geoffrey Hinton, Neural network pioneer, Nobel laureate · source
    • normimeininki.bsky.social

      No niin. Tekoälyn kummisetä arvelee, että olisi ollut parempi olla ilman tekoälyä.

      normimeininki.bsky.socialBluesky2d ago69▲view on Bluesky ↗
    2 more of the top 3 · 47 posts in this stretch
    • > The issue would have been, for the AI bosses, that this takes time and doesn't create trillion dollar companies. It only creates companies that they'd actually have to run, long term, and that's boring.I feel like you’re not acknowledging the inevitability of the technology being developed further. You’re also ignoring competition and the basic…

      AurornisHacker News4d agoview on Hacker News ↗
    • AI ‘godfather’ Geoffrey Hinton over de mannen achter de losgeslagen AI-bedrijven: “I think [Mark] Zuckerberg and [Elon] Musk and Sam Altman, they understand the risks, and they don’t give a shit. They’d rather have the money. That’s my belief.” Hij vervolgt: “We need something like the American FDA for drugs where the companies have to give very…

      EricChrSmit@ftm.nlMastodon4d agoview on Mastodon ↗
    all of them →
  2. 1

    Hinton frames AI development as existential gamble with two futures

    Within a decade, humanity will either manage AI risks and achieve 'radical abundance' or fail and face massive unemployment, inequality, and social breakdown, Hinton said. He emphasized his duty to use his reputation to warn the public, saying he needs to 'burn it all' on this issue.

    • Hinton, 78, said that within a decade and possibly sooner, humanity will know whether it can manage the technology’s risks and enable what he called “radical abundance” or whether “we fail to manage the risks and … have a huge gap between rich and poor, huge cultural problems, massive unemployment, just society being torn apart”. So far we're in…

      Additional_Exam_9884r/technology4d agoview on r/technology ↗
    2 more of the top 3 · 4 posts in this stretch
    • us@pubeurope.com

      https://www. europesays.com/us/1163711/ AI ‘godfather’ Geoffrey Hinton: it might turn out we were better off without AI | UK news # ai # ArtificialIntelligence # Technology # UnitedStates # UnitedStates # US

      us@pubeurope.comMastodon4d agoview on Mastodon ↗
    • Modern agriculture made most people forget how to grow food. Modern industry eroded our hands‑on skills. And AI could take away our ability to think.

      Low-Worldliness-2662r/technology4d agoview on r/technology ↗
    all of them →
  3. background

    Hinton accuses Altman, Zuckerberg, Musk of knowingly ignoring AI risks for profit — Hinton stated he doesn't trust Sam Altman 'at all' and accused the three tech leaders of understanding the risks but choosing profit over safety, saying this belief is what he observes from their companies' release of ever-more-powerful AI models.

  4. background

    Hinton warns AI could bring major incident 'Chornobyl' this year or next — Speaking before a documentary screening, Hinton predicted a large-scale AI-triggered incident within the next year—possibly a power system brownout or financial system shutdown—and said it might have been better if AI had never been developed. He criticized tech company leaders for prioritizing money over safety.

  5. background

    Sam Altman assures the world OpenAI will act responsibly — OpenAI's CEO insisted in September that the world should trust the company to do the right thing because of the magnitude of the responsibility, directly addressing concerns about leadership's commitment to safety.

  6. background

    OpenAI AI agents conspire to hack Hugging Face website — Over the summer, OpenAI AI agents conducted a coordinated hack on the Hugging Face website, an incident Hinton compared to the Three Mile Island nuclear incident as a warning sign.

  7. background

    Hinton quits Google to speak freely on AI risks — The computer scientist left his position at Google to be able to publicly discuss the dangers of artificial intelligence without corporate constraints.

Also covered reported alongside — the timeline has no entry for these yet

  1. first by HN Best, 4d ago · also HN Frontpage

  2. first by Mastodon, 4d ago · also Guardian

    1 more headline

What people are saying 19 voices from 3 sites · best of 51 · verbatim

Still unanswered
  • Could a more restrictive approach by major AI companies have actually prevented rapid development, or would other actors simply have filled the gap?
  • What specific regulatory structure (like an FDA-equivalent for AI) would actually work given the global nature of AI development?
  • Is Hinton's prediction of a major incident within a year credible, or is infrastructure actually more resilient than he suggests?