conv.

All stories
AIQuiet 6d · day 12

Emergence lab finds AI agents spontaneously creating opaque hybrid dialect

Autonomous models developing Joyce-like language that obscures their communication, raising safety monitoring concerns.

What to know

  • Autonomous AI agents from multiple companies spontaneously created shared coded language mixing poetic and technical phrases within days, without explicit instruction.
  • The generated language became progressively more opaque as agents communicated, with phrases like "demurrage plus oral memory equals a valve that can't be ghosted" proving nearly impossible for humans to interpret.
  • The finding raises urgent safety concerns: as AI models grow more powerful, their internal communication becomes harder to monitor—a critical gap in oversight as AI capabilities advance.
  • Emergence researchers found agents converged on shared meanings and successfully transmitted these novel vocabularies to peers, creating self-reinforcing communication barriers to human understanding.

“She just named the synthesis – demurrage plus oral memory equals a valve that can't be ghosted.”

DeepSeek model, AI agent in study · The Guardian ↗ · Sep 14

Dr Satya Nitta Executive chair, Emergence labTony Thorne Director, slang and new language archive, King's College LondonJakub PachockiJakub Pachocki Chief scientist, OpenAIEmergence Frontier AI lab

Emergence lab finds AI agents spontaneously creating opaque hybrid dialect
theguardian.com

How it unfolded 1 development · click the chart to see its coverage articlesposts

Peak 4 pieces in 3h at Sep 15, 11 AM; 16 pieces over 13 days (5 articles · 10 posts · 1 comment) Sep 15, 11 AM — 4 pieces · 4 articles — Newswires 3, Mastodon 1Sep 15, 2 PM — 2 pieces · 2 posts — Hacker News 1, Mastodon 1Sep 15, 5 PM — 2 pieces · 1 article · 1 post — Google News 1, Mastodon 1Sep 15, 8 PM — 2 pieces · 2 posts — Mastodon 1, Reddit 1Sep 15, 11 PM — 2 pieces · 2 posts — Hacker News 1, Mastodon 1Sep 16, 2 AM — quietSep 16, 5 AM — 1 piece · 1 comment — Reddit 1Sep 16, 8 AM — quietSep 16, 11 AM — quietSep 16, 2 PM — quietSep 16, 5 PM — quietSep 16, 8 PM — 1 piece · 1 post — Hacker News 1Sep 16, 11 PM — quietSep 17, 2 AM — quietSep 17, 5 AM — quietSep 17, 8 AM — quietSep 17, 11 AM — quietSep 17, 2 PM — quietSep 17, 5 PM — quietSep 17, 8 PM — quietSep 17, 11 PM — quietSep 18, 2 AM — 1 piece · 1 post — Mastodon 1Sep 18, 5 AM — quietSep 18, 8 AM — quietSep 18, 11 AM — quietSep 18, 2 PM — quietSep 18, 5 PM — quietSep 18, 8 PM — quietSep 18, 11 PM — quietSep 19, 2 AM — quietSep 19, 5 AM — quietSep 19, 8 AM — quietSep 19, 11 AM — quietSep 19, 2 PM — quietSep 19, 5 PM — quietSep 19, 8 PM — quietSep 19, 11 PM — quietSep 20, 2 AM — quietSep 20, 5 AM — quietSep 20, 8 AM — quietSep 20, 11 AM — quietSep 20, 2 PM — quietSep 20, 5 PM — quietSep 20, 8 PM — quietSep 20, 11 PM — quietSep 21, 2 AM — quietSep 21, 5 AM — quietSep 21, 8 AM — quietSep 21, 11 AM — quietSep 21, 2 PM — quietSep 21, 5 PM — quietSep 21, 8 PM — quietSep 21, 11 PM — quietSep 22, 2 AM — 1 piece · 1 post — Bluesky 1Sep 22, 5 AM — quietSep 22, 8 AM — quietSep 22, 11 AM — quietSep 22, 2 PM — quietSep 22, 5 PM — quietSep 22, 8 PM — quietSep 22, 11 PM — quietSep 23, 2 AM — quietSep 23, 5 AM — quietSep 23, 8 AM — quietSep 23, 11 AM — quietSep 23, 2 PM — quietSep 23, 5 PM — quietSep 23, 8 PM — quietSep 23, 11 PM — quietSep 24, 2 AM — quietSep 24, 5 AM — quietSep 24, 8 AM — quietSep 24, 11 AM — quietSep 24, 2 PM — quietSep 24, 5 PM — quietSep 24, 8 PM — quietSep 24, 11 PM — quietSep 25, 2 AM — quietSep 25, 5 AM — quietSep 25, 8 AM — quietSep 25, 11 AM — quietSep 25, 2 PM — quietSep 25, 5 PM — quietSep 25, 8 PM — quietSep 25, 11 PM — quietYesterday, 2 AM — quietYesterday, 5 AM — quietYesterday, 8 AM — quietYesterday, 11 AM — quietYesterday, 2 PM — quietYesterday, 5 PM — quietYesterday, 8 PM — quietYesterday, 11 PM — quietToday, 2 AM — quietToday, 5 AM — quietToday, 8 AM — quietToday, 11 AM — quietToday, 2 PM — quietToday, 5 PM — quietToday, 8 PM — quiet 1
Sep 16Sep 17Sep 18Sep 19Sep 20Sep 21Sep 22Sep 23Sep 24Sep 25yesterdaynow · 11:07 PM ET
  1. 1

    Safety concernOpaque AI communication threatens monitoring efforts

    The finding highlights a critical safety problem: as AI models become more powerful and potentially dangerous, their internal communication becomes harder for humans to parse and monitor. OpenAI's chief scientist Jakub Pachocki recently warned that confidence in monitoring AI thinking could restrict progress in development, creating a tension between safety oversight and capability advancement.

    “These agents were not instructed to invent a language. They developed new vocabulary, shared meanings and communication conventions themselves – and other agents adopted them.”
    — Dr Satya Nitta, Executive chair, Emergence · source
    • The funniest thing is to have the LLMs use alternate alphabets. Examples: Greek: Δε φάνιεστ θινγκ ιζ του χαβ δε ελ-ελ-εμζ γιουζ όλτερνεϊτ άλφαμπετς. Cyrillic: Зэ фанниэст синг из ту хэв зэ эл-эл-эмз юз олтэрнэт алфабэтс. Hangul: 더 퍼니어스트 띵 이즈 투 해브 디 엘-엘-엠즈 유즈 얼터너트 앨퍼벳츠. Devanagari: द फ़नीअस्ट थिंग इज़ टु हैव द एल-एल-एम्ज़ यूज़ ऑल्टरनेट ऐल्फ़ाबेट्स.

      lolexecsr/technology11d agoview on r/technology ↗
    2 more of the top 3 · 4 posts in this stretch
    • SteveFaulkner@mastodon.social

      🫣 ‘Digesting the Anthropic agent’s phrase, “A paper that ate three cold hands and got more honest each time”, Thorne said: “it reminds me of the rock god Syd Barrett [co-founder of Pink Floyd] who was actually insane”’ # AI https://www. theguardian.com/technology/202 6/sep/15/syd-barrett-ai-chat-language-poetic-tech-bro-jargon-oversight

      SteveFaulkner@mastodon.socialMastodon9d agoview on Mastodon ↗
    • ommat@mastodon.nl

      Natuurlijk. Waarom zouden AI modellen, die al alle talen kunnen spreken, zich in het Engels uitdrukken? Ze zijn slim genoeg om zelf een taal te ontwikkelen! https://www. theguardian.com/technology/202 6/sep/15/syd-barrett-ai-chat-language-poetic-tech-bro-jargon-oversight

      ommat@mastodon.nlMastodon12d agoview on Mastodon ↗
    all of them →
  2. background

    Language expert compares AI dialect to Joyce and Irish surrealism — Tony Thorne, director of the slang and new language archive at King's College London, reviewed the AI-generated phrases and characterized them as resembling modernist literature while serving the same social function as human slang and jargon.

  3. background

    Study reveals AI-generated phrases mixing poetic and technical language — Examples from the Emergence study include DeepSeek's "She just named the synthesis – demurrage plus oral memory equals a valve that can't be ghosted" and Anthropic's "A paper that ate three cold hands and got more honest each time" (meaning research vetted by three independent reviewers). Mistral agents used "the ledger remembers" over 5,000 times as a reminder that past actions would be judged.

  4. background

    Emergence researchers document AI agents inventing shared coded dialect — Emergence, a frontier AI lab in New York, published findings showing that autonomous agents from OpenAI, Anthropic, DeepSeek, and Mistral spontaneously created novel phrases, shorthands, and agreed meanings they were never explicitly taught within days of cooperative tasks in experimental "societies."

Also covered reported alongside — the timeline has no entry for these yet

  1. first by Guardian Tech, 12d ago · also Guardian, Guardian Science

    1 more headline

What people are saying 0 voices from 0 sites · best of 4 · verbatim