AI
Researchers identify Matthew Effect bias in LLM reinforcement learning
Blog post released explaining Matthew Effect and Never Give Up technique
2
Sep 15 3:07 PM
· 12d ago · 1 article · 2 posts · 3 sources · development 2 of 2
Michael Noukhovitch published an interactive blog post accompanying the arxiv paper, breaking down the phenomenon with eval curves from Olmo 3.1 RL-Zero Math training on AIME 2025 questions.
“The majority of our improvements are coming from the easiest problems going from somewhat solved to mostly solved. The hardest problems are barely improving.”
Michael Noukhovitch
Michael Noukhovitch Lead researcher Hamish Ivison Co-author Nathan Lambert Co-author Aaron Courville Co-author
The whole story articles posts
the bright band is this development · numbered dots are the others · click one to jump
Peak 2 pieces in 3h at Sep 15, 2 PM; 4 pieces over 13 days (2 articles · 2 posts)
Sep 14, 11 PM — 1 piece · 1 article — Newswires 1 Sep 15, 2 AM — quiet Sep 15, 5 AM — quiet Sep 15, 8 AM — quiet Sep 15, 11 AM — quiet Sep 15, 2 PM — 2 pieces · 1 article · 1 post — Hacker News 1, Newswires 1 Sep 15, 5 PM — 1 piece · 1 post — Mastodon 1 Sep 15, 8 PM — quiet Sep 15, 11 PM — quiet Sep 16, 2 AM — quiet Sep 16, 5 AM — quiet Sep 16, 8 AM — quiet Sep 16, 11 AM — quiet Sep 16, 2 PM — quiet Sep 16, 5 PM — quiet Sep 16, 8 PM — quiet Sep 16, 11 PM — quiet Sep 17, 2 AM — quiet Sep 17, 5 AM — quiet Sep 17, 8 AM — quiet Sep 17, 11 AM — quiet Sep 17, 2 PM — quiet Sep 17, 5 PM — quiet Sep 17, 8 PM — quiet Sep 17, 11 PM — quiet Sep 18, 2 AM — quiet Sep 18, 5 AM — quiet Sep 18, 8 AM — quiet Sep 18, 11 AM — quiet Sep 18, 2 PM — quiet Sep 18, 5 PM — quiet Sep 18, 8 PM — quiet Sep 18, 11 PM — quiet Sep 19, 2 AM — quiet Sep 19, 5 AM — quiet Sep 19, 8 AM — quiet Sep 19, 11 AM — quiet Sep 19, 2 PM — quiet Sep 19, 5 PM — quiet Sep 19, 8 PM — quiet Sep 19, 11 PM — quiet Sep 20, 2 AM — quiet Sep 20, 5 AM — quiet Sep 20, 8 AM — quiet Sep 20, 11 AM — quiet Sep 20, 2 PM — quiet Sep 20, 5 PM — quiet Sep 20, 8 PM — quiet Sep 20, 11 PM — quiet Sep 21, 2 AM — quiet Sep 21, 5 AM — quiet Sep 21, 8 AM — quiet Sep 21, 11 AM — quiet Sep 21, 2 PM — quiet Sep 21, 5 PM — quiet Sep 21, 8 PM — quiet Sep 21, 11 PM — quiet Sep 22, 2 AM — quiet Sep 22, 5 AM — quiet Sep 22, 8 AM — quiet Sep 22, 11 AM — quiet Sep 22, 2 PM — quiet Sep 22, 5 PM — quiet Sep 22, 8 PM — quiet Sep 22, 11 PM — quiet Sep 23, 2 AM — quiet Sep 23, 5 AM — quiet Sep 23, 8 AM — quiet Sep 23, 11 AM — quiet Sep 23, 2 PM — quiet Sep 23, 5 PM — quiet Sep 23, 8 PM — quiet Sep 23, 11 PM — quiet Sep 24, 2 AM — quiet Sep 24, 5 AM — quiet Sep 24, 8 AM — quiet Sep 24, 11 AM — quiet Sep 24, 2 PM — quiet Sep 24, 5 PM — quiet Sep 24, 8 PM — quiet Sep 24, 11 PM — quiet Sep 25, 2 AM — quiet Sep 25, 5 AM — quiet Sep 25, 8 AM — quiet Sep 25, 11 AM — quiet Sep 25, 2 PM — quiet Sep 25, 5 PM — quiet Sep 25, 8 PM — quiet Sep 25, 11 PM — quiet Yesterday, 2 AM — quiet Yesterday, 5 AM — quiet Yesterday, 8 AM — quiet Yesterday, 11 AM — quiet Yesterday, 2 PM — quiet Yesterday, 5 PM — quiet Yesterday, 8 PM — quiet Yesterday, 11 PM — quiet Today, 2 AM — quiet Today, 5 AM — quiet Today, 8 AM — quiet Today, 11 AM — quiet Today, 2 PM — quiet Today, 5 PM — quiet Today, 8 PM — quiet
1 2
Sep 15 Sep 16 Sep 17 Sep 18 Sep 19 Sep 20 Sep 21 Sep 22 Sep 23 Sep 24 Sep 25 yesterday now · 11:09 PM ET
Reported in the same hours
no headline names this development itself — these 1 claim were published in its stretch
first by HN Frontpage , 12d ago · also arXiv cs.AI
All 2 developments of Researchers identify Matthew Effect bias in LLM… →
Newswires Hacker News Mastodon