conv.

← The whole story
AI
Academics Set Minimum Standards for Embedded AI Evaluators

Academics publish letter on minimum conditions for embedded AI evaluators

1 Sep 18 12:34 PM · 8d ago · 1 post · 1 source · development 1 of 3

The AI Evaluator Forum releases an open letter signed by researchers from MIT, Cambridge, Carnegie Mellon, Berkeley, Wisconsin-Madison, Uppsala, UNC Chapel Hill and a 2024 Nobel physics laureate, setting out minimum conditions—scientific objectivity, transparency, independence, and protection from interference—that third-party evaluators embedded within frontier AI companies must meet to be credible.

“We believe that all frontier AI companies should embed evaluators to independently assess AI risks, including evaluating the systems themselves and any significant incidents of real-world harm”

AI Evaluator Forum open letter

AI Evaluator Forum Organizer of the open letterNobel Laureate in Physics (2024) Signatory, University Professor Emeritus, University of TorontoFrontier AI companies (unnamed, footnoted 1–5) Subjects of the letter's demands

The whole story articlesposts the bright band is this development · numbered dots are the others · click one to jump

Peak 2 pieces in two hours at Sep 18, 4 PM; 5 pieces over 8 days (1 article · 4 posts) Sep 18, 12 PM — 1 piece · 1 post — Hacker News 1Sep 18, 2 PM — quietSep 18, 4 PM — 2 pieces · 1 article · 1 post — Newswires 1, Reddit 1Sep 18, 6 PM — quietSep 18, 8 PM — quietSep 18, 10 PM — quietSep 19, 12 AM — quietSep 19, 2 AM — quietSep 19, 4 AM — quietSep 19, 6 AM — quietSep 19, 8 AM — quietSep 19, 10 AM — quietSep 19, 12 PM — quietSep 19, 2 PM — quietSep 19, 4 PM — quietSep 19, 6 PM — quietSep 19, 8 PM — quietSep 19, 10 PM — quietSep 20, 12 AM — quietSep 20, 2 AM — quietSep 20, 4 AM — quietSep 20, 6 AM — quietSep 20, 8 AM — quietSep 20, 10 AM — quietSep 20, 12 PM — quietSep 20, 2 PM — quietSep 20, 4 PM — quietSep 20, 6 PM — quietSep 20, 8 PM — quietSep 20, 10 PM — quietSep 21, 12 AM — quietSep 21, 2 AM — quietSep 21, 4 AM — 1 piece · 1 post — Mastodon 1Sep 21, 6 AM — quietSep 21, 8 AM — 1 piece · 1 post — Mastodon 1Sep 21, 10 AM — quietSep 21, 12 PM — quietSep 21, 2 PM — quietSep 21, 4 PM — quietSep 21, 6 PM — quietSep 21, 8 PM — quietSep 21, 10 PM — quietSep 22, 12 AM — quietSep 22, 2 AM — quietSep 22, 4 AM — quietSep 22, 6 AM — quietSep 22, 8 AM — quietSep 22, 10 AM — quietSep 22, 12 PM — quietSep 22, 2 PM — quietSep 22, 4 PM — quietSep 22, 6 PM — quietSep 22, 8 PM — quietSep 22, 10 PM — quietSep 23, 12 AM — quietSep 23, 2 AM — quietSep 23, 4 AM — quietSep 23, 6 AM — quietSep 23, 8 AM — quietSep 23, 10 AM — quietSep 23, 12 PM — quietSep 23, 2 PM — quietSep 23, 4 PM — quietSep 23, 6 PM — quietSep 23, 8 PM — quietSep 23, 10 PM — quietSep 24, 12 AM — quietSep 24, 2 AM — quietSep 24, 4 AM — quietSep 24, 6 AM — quietSep 24, 8 AM — quietSep 24, 10 AM — quietSep 24, 12 PM — quietSep 24, 2 PM — quietSep 24, 4 PM — quietSep 24, 6 PM — quietSep 24, 8 PM — quietSep 24, 10 PM — quietYesterday, 12 AM — quietYesterday, 2 AM — quietYesterday, 4 AM — quietYesterday, 6 AM — quietYesterday, 8 AM — quietYesterday, 10 AM — quietYesterday, 12 PM — quietYesterday, 2 PM — quietYesterday, 4 PM — quietYesterday, 6 PM — quietYesterday, 8 PM — quietYesterday, 10 PM — quietToday, 12 AM — quietToday, 2 AM — quietToday, 4 AM — quietToday, 6 AM — quietToday, 8 AM — quietToday, 10 AM — quietToday, 12 PM — quiet 1–3
1–3Academics publish letter on minimum…
Sep 19Sep 20Sep 21Sep 22Sep 23Sep 24yesterdaynow · 2:02 PM ET

All 3 developments of Academics Set Minimum Standards for Embedded AI Evaluators →

Hacker NewsRedditNewswiresMastodon