conv.

All stories
AIQuiet 10d · day 12

IETF draft proposes robots.txt-based signal for AI training opt-outs

A new Internet-Draft lets website operators mark paths as off-limits (or open) to AI training using ordinary robots.txt syntax.

What to know

  • The draft defines a way to signal 'no AI training' (or an opt-in) for specific paths using standard robots.txt syntax, requiring no new grammar.
  • Legacy parsers that don't recognize the new policy-token user agent will ignore it and behave exactly as before, per the draft's design goals.
  • It is an early-stage Internet-Draft (work in progress, valid six months) under the IETF AI Preferences Working Group, not an adopted standard.
  • Public engagement so far is minimal: the Hacker News submission has a score of 1 and no comments.

Kelley Author of the Internet-DraftIETF AI Preferences Working Group Working group discussing the draft

How it unfolded 2 developments, newest first · click a bar or a number to jump articlesposts

Peak 1 piece in 3h at Oct 30, 4 PM; 3 pieces over 12 days (1 article · 2 posts) Oct 30, 4 PM — 1 piece · 1 article — Newswires 1Oct 30, 7 PM — quietOct 30, 10 PM — quietOct 31, 1 AM — quietOct 31, 4 AM — quietOct 31, 7 AM — quietOct 31, 10 AM — quietOct 31, 1 PM — quietOct 31, 4 PM — quietOct 31, 7 PM — quietOct 31, 10 PM — quietNov 1, 1 AM — quietNov 1, 3 AM — quietNov 1, 6 AM — quietNov 1, 9 AM — quietNov 1, 12 PM — 1 piece · 1 post — Hacker News 1Nov 1, 3 PM — quietNov 1, 6 PM — quietNov 1, 9 PM — quietNov 2, 12 AM — 1 piece · 1 post — Mastodon 1Nov 2, 3 AM — quietNov 2, 6 AM — quietNov 2, 9 AM — quietNov 2, 12 PM — quietNov 2, 3 PM — quietNov 2, 6 PM — quietNov 2, 9 PM — quietNov 3, 12 AM — quietNov 3, 3 AM — quietNov 3, 6 AM — quietNov 3, 9 AM — quietNov 3, 12 PM — quietNov 3, 3 PM — quietNov 3, 6 PM — quietNov 3, 9 PM — quietNov 4, 12 AM — quietNov 4, 3 AM — quietNov 4, 6 AM — quietNov 4, 9 AM — quietNov 4, 12 PM — quietNov 4, 3 PM — quietNov 4, 6 PM — quietNov 4, 9 PM — quietNov 5, 12 AM — quietNov 5, 3 AM — quietNov 5, 6 AM — quietNov 5, 9 AM — quietNov 5, 12 PM — quietNov 5, 3 PM — quietNov 5, 6 PM — quietNov 5, 9 PM — quietNov 6, 12 AM — quietNov 6, 3 AM — quietNov 6, 6 AM — quietNov 6, 9 AM — quietNov 6, 12 PM — quietNov 6, 3 PM — quietNov 6, 6 PM — quietNov 6, 9 PM — quietNov 7, 12 AM — quietNov 7, 3 AM — quietNov 7, 6 AM — quietNov 7, 9 AM — quietNov 7, 12 PM — quietNov 7, 3 PM — quietNov 7, 6 PM — quietNov 7, 9 PM — quietNov 8, 12 AM — quietNov 8, 3 AM — quietNov 8, 6 AM — quietNov 8, 9 AM — quietNov 8, 12 PM — quietNov 8, 3 PM — quietNov 8, 6 PM — quietNov 8, 9 PM — quietNov 9, 12 AM — quietNov 9, 3 AM — quietNov 9, 6 AM — quietNov 9, 9 AM — quietNov 9, 12 PM — quietNov 9, 3 PM — quietNov 9, 6 PM — quietNov 9, 9 PM — quietYesterday, 12 AM — quietYesterday, 3 AM — quietYesterday, 6 AM — quietYesterday, 9 AM — quietYesterday, 12 PM — quietYesterday, 3 PM — quietYesterday, 6 PM — quietYesterday, 9 PM — quietToday, 12 AM — quietToday, 3 AM — quietToday, 6 AM — quietToday, 9 AM — quietToday, 12 PM — quietToday, 3 PM — quietToday, 6 PM — quiet 12
Oct 31Nov 1Nov 2Nov 3Nov 4Nov 5Nov 6Nov 7Nov 8Nov 9yesterdaynow · 9:50 PM ET
  1. 2

    Draft surfaces on Hacker News with minimal traction

    User mehdizare posts the draft to Hacker News; as of the latest data it has a score of 1 and no comments, indicating the discussion has not yet developed.

    “A service operator binds usage preferences (e.g., "no AI training") to paths by writing ordinary robots.txt groups keyed by a per-purpose policy token in the User-Agent line.”
    — draft-kelley-aipref-training-preference-signal-00, IETF Internet-Draft text · source
    • DJPRMF@mastodon.social

      Finalmente uma forma simples de controlar o que se quer ou não para treinar a IA (ainda em draft). Agora basta é as empresas de IA seguirem realmente isso. 🤷‍♂️ https:// datatracker.ietf.org/doc/draft -kelley-aipref-training-preference-signal/

      DJPRMF@mastodon.socialMastodon9d agoview on Mastodon ↗
  2. 1 day quiet
  3. 1

    IETF datatracker publishes AI-training preference draft

    The Internet-Draft draft-kelley-aipref-training-preference-signal-00, 'Machine-Readable Training Preference Signal,' is listed on the IETF Datatracker, proposing a robots.txt-based mechanism for signaling AI training preferences.

    1. first by IETF Datatracker, 12d ago

  4. background

    Draft details a backward-compatible robots.txt extension — The document specifies that preferences are expressed via a per-purpose policy token in the User-Agent line, introduce no new directive names or grammar, support path-specific bindings (e.g., disallowing training sitewide but allowing it under /press-kit/), and leave behavior unchanged for parsers that don't implement the mechanism.