conv.

All stories
AIQuiet 6d · day 6

Researcher reports Anthropic's Fable 5 performs worse after subscription rollout

User measurements show the model delivered significantly fewer thinking tokens in August after permanent availability on paid plans.

newest coverage 5d agosummary written 4d ago2 pieces1.2k likes & upvotes49 comments XMastodon

What to know

  • A researcher publicly reported that Anthropic's Fable 5 model performs noticeably worse after being made permanently available in subscription plans.
  • The performance decline was measured across five different methods, with August showing significantly fewer thinking tokens than July.
  • The observation raises questions about whether model degradation is intentional, accidental, or related to operational changes following the subscription rollout.

Lon Lundgren Researcher / Model UserAnthropic AI Company

Researcher reports Anthropic's Fable 5 performs worse after subscription rollout
x.com

How it unfolded 1 development · click the chart to see its coverage posts

Peak 2 pieces in two hours at Sep 20, 5 PM; 2 pieces over 6 days (1 article · 1 post) Sep 20, 5 PM — 2 pieces · 1 article · 1 post — Mastodon 1, X 1Sep 20, 7 PM — quietSep 20, 9 PM — quietSep 20, 11 PM — quietSep 21, 1 AM — quietSep 21, 3 AM — quietSep 21, 5 AM — quietSep 21, 7 AM — quietSep 21, 9 AM — quietSep 21, 11 AM — quietSep 21, 1 PM — quietSep 21, 3 PM — quietSep 21, 5 PM — quietSep 21, 7 PM — quietSep 21, 9 PM — quietSep 21, 11 PM — quietSep 22, 1 AM — quietSep 22, 3 AM — quietSep 22, 5 AM — quietSep 22, 7 AM — quietSep 22, 9 AM — quietSep 22, 11 AM — quietSep 22, 1 PM — quietSep 22, 3 PM — quietSep 22, 5 PM — quietSep 22, 7 PM — quietSep 22, 9 PM — quietSep 22, 11 PM — quietSep 23, 1 AM — quietSep 23, 3 AM — quietSep 23, 5 AM — quietSep 23, 7 AM — quietSep 23, 9 AM — quietSep 23, 11 AM — quietSep 23, 1 PM — quietSep 23, 3 PM — quietSep 23, 5 PM — quietSep 23, 7 PM — quietSep 23, 9 PM — quietSep 23, 11 PM — quietSep 24, 1 AM — quietSep 24, 3 AM — quietSep 24, 5 AM — quietSep 24, 7 AM — quietSep 24, 9 AM — quietSep 24, 11 AM — quietSep 24, 1 PM — quietSep 24, 3 PM — quietSep 24, 5 PM — quietSep 24, 7 PM — quietSep 24, 9 PM — quietSep 24, 11 PM — quietYesterday, 1 AM — quietYesterday, 3 AM — quietYesterday, 5 AM — quietYesterday, 7 AM — quietYesterday, 9 AM — quietYesterday, 11 AM — quietYesterday, 1 PM — quietYesterday, 3 PM — quietYesterday, 5 PM — quietYesterday, 7 PM — quietYesterday, 9 PM — quietYesterday, 11 PM — quietToday, 1 AM — quietToday, 3 AM — quietToday, 5 AM — quietToday, 7 AM — quietToday, 9 AM — quiet 1
Sep 21Sep 22Sep 23Sep 24yesterdaynow · 11:46 AM ET
  1. 1

    Lundgren measures sharp performance decline in Fable 5 after subscription launch

    Lon Lundgren posted observations that after Anthropic made Fable 5 permanently available in subscription plans, the model's performance degraded noticeably. Measuring five different ways, he found August delivered dramatically fewer thinking tokens than July.

    “After Anthropic made Fable 5 permanently available in subscription plans, I noticed a large drop in performance. The model felt dumber, and I couldn't explain why.”
    — Lon Lundgren
    1. 1 outlet Lon Lundgren (@Lon) on X

      first by Mastodon, 5d ago

    • After Anthropic made Fable 5 permanently available in subscription plans, I noticed a large drop in performance. The model felt dumber, and I couldn't explain why. Measured five different ways, August delivered dramatically fewer thinking tokens than July.

      @LonX5d ago1.1k▲view on X ↗