Ex-Anthropic researcher Jacob Coxon's resignation letter over AI risk goes viral
A blog essay linking Coxon's safety-driven exit — and an Anthropic alignment lead's public agreement — to Frances Haugen's 2021 Facebook whistleblowing hits the front page of Hacker News.
What to know
- Jacob Coxon left Anthropic before his equity vested, forfeiting it to publicly warn that competitive pressure forces safety corner-cutting.
- Anthropic alignment lead Evan Hubinger publicly corroborated Coxon's claim that staff believe AI could pose an existential threat within a decade.
- An essay comparing Coxon to 2021 Facebook whistleblower Frances Haugen went viral on Hacker News, drawing over 100 comments debating individual moral responsibility in tech.
- The wider essay also cites survey data on tech-worker burnout and AI-generated code debugging, broadening the story beyond one resignation into a critique of industry culture.
The dispute Whether resigning over AI safety concerns is a meaningful moral act or a largely symbolic gesture against systemic incentives that won't change regardless. · positions read across 19 posts and comments
The risk claims are serious enough that continuing to work at these labs is morally indefensible.
-
“I'm not sure what more we need to wait for, if the claim "10% it ends humanity" is not enough.”
ArcHound · Hacker News ↗
Morality isn't binary and the essay oversimplifies most day-to-day work decisions.
-
“Life isn't black and white with "good/bad". Further, there's no objective measure of what is good or bad. Everything is a shade of gray.”
cogman10 · Hacker News ↗
The essay's author is inconsistent, since taking Coxon seriously requires believing frontier models are genuinely powerful, not hype.
-
“The author of this blog is an AI skeptic (see the backlog of posts). That's fine, but it's hard to square with this particular post.”
tptacek · Hacker News ↗
Individual departures are symbolic; the economic system that rewards this behavior would collapse if everyone acted this way, so nothing really changes.
-
“If everyone doing a 'bad thing' stepped off the hamster wheel today, the world economy would collapse before markets closed.”
bravoetch · Hacker News ↗
Jacob Coxon Former Anthropic pretraining researcherEvan Hubinger Anthropic alignment team lead
Frances Haugen Former Facebook employee, 2021 whistleblower
How it unfolded 2 developments, newest first · click a bar or a number to jump articlespostscomments
-
2
HN commenters split over whether quitting is a moral obligation
Commenters debated whether individual departures like Coxon's meaningfully address systemic AI risk, whether 'good' and 'bad' can be cleanly defined for tech work, and whether the essay's author is consistent given a stated skepticism about frontier AI capability elsewhere in the blog.
“I'm not sure what more we need to wait for, if the claim "10% it ends humanity" is not enough.”
— ArcHound -
I would rather say the argument is simplified, but on a decent track. Because there are two angles to it.I've been wondering what sectors I wouldn't maintain and develop infrastructure for, because I consider it a strength of mine that I don't entirely care about that. I'm not excited about your product, for good or bad.Defense for example is on…
2 more of the top 3 · 19 posts in this stretch
-
A
Trading morale for money is not a career decision but a transaction. It is a transaction where you sell the part of you that was supposed to care. Do that often enough, and it does not come back. That is not burnout, but it is still a disease. Although, like every disease, it spreads: first to your team, then to your product, then to the people…
-
I disagree with this article and here's why.Life isn't black and white with "good/bad". Further, there's no objective measure of what is good or bad. Everything is a shade of gray.You certainly could argue that some actions are absolutely good or absolutely bad, but those aren't the majority of actions people take on a day to day basis. People…
-
-
1
Essay reaches HN front page and spreads via Mastodon
The essay was posted to Hacker News and reposted across Mastodon accounts within the same window, quickly accumulating dozens of comments and cross-platform shares.
“I resigned from Anthropic today. … They are racing straight to self-improving superintelligence and gambling with our lives.”
— Jacob Coxon, Former Anthropic researcher · source -
background
Essay ties Coxon's exit to Frances Haugen's 2021 whistleblowing — A carette.xyz essay titled 'Good people refuse to do bad things' frames Coxon's resignation as a repeat of Frances Haugen's 2021 decision to leave Facebook and testify before the US Senate over internal research on Instagram's harm to teens, and argues the pattern reflects broader tech-worker complicity and burnout.
-
background
Anthropic alignment lead Evan Hubinger confirms Coxon's warning — Evan Hubinger, described as an alignment team lead at Anthropic, publicly agreed that the company earnestly believes AI could kill all humans and said Anthropic lacks a clear plan to solve superintelligence alignment.
-
background
Jacob Coxon resigns from Anthropic over AI safety concerns — Coxon, a pretraining researcher who had worked at both OpenAI and Anthropic, resigned and gave up equity that had not yet vested, saying the labs are racing toward self-improving superintelligence without acting responsibly.
What people are saying 16 voices from 2 sites · best of 19 · verbatim
- Would the tech-worker burnout survey's 53% 'steer newcomers away' figure look different compared across other professions?
- Is it consistent for an AI-skeptic blog to treat Coxon's existential-risk warning as credible?
- Sep 22
-
How convenient would it be if the line between good and evil cuts between individuals and not through every human heart.
- Sep 21
-
M
Claim of the moment: "good people refuse to do bad things" https:// carette.xyz/posts/good_people_ refuse_to_do_bad_things/ # MachineSociety
-
I like to think of good in terms of direct positive effect, and bad in terms of direct negative externalities. Second order effects become too fuzzy.Do the people working for AI labs believe that it has a better direct beneficial effect, or makes for a worse outcome on society?What I've read thus far heavily lead me to believe that the balance is…
-
You can also use moral relativism to cope with doing basically anything unethical, especially so when you’re offered dump trucks full of money.
-
>The accusation>So, why are you still working for them?>If the answer is the salary, say it louder, and do not force yourself to make excuses.>If the answer is “someone worse would replace me”, say it too, and louder too.>If the answer is “I can change things from the inside”, then show me what you changed. Haugen tried the inside. Coxon tried the…
-
I understand the concern about your work being used to cause harm, but I also worry about the development of 'forbidden knowledge'. What does it mean to say a branch of science and engineering is too dangerous of a path to go down? Does it mean scientists are persecuted just for asking questions and designing experiments to find answers? Will…
-
There may not be a definition of “good”.But there are several workable contextual definitions of bad; it’s your job to know what they are.For example:- it would cause a harm to someone who was not made aware of the risk up front.- it would cause someone to lose a job they didn’t know was under threat.- the way the harm occurs precludes its only…
-
I agree.In the particular case of AI companies, I think a handbrake should be pulled when they start claiming things like "10% chance we're ending humanity."
-
It's refreshing to see a well-argued and balanced essay on AI risk being upvoted on Hacker News.
-
The author of this blog is an AI skeptic (see the backlog of posts). That's fine, but it's hard to square with this particular post. To take Coxon's argument seriously, you have to believe frontier models are hypercapable, and not just hype objects. That's what Coxon believes and why he left.
-
A few big good/bad decisions are more important than thousands of trivial decisions.Balancing good against bad is not clear, I agree, but that makes it all the more important to think about it when making a big decision such as what job to take.Its hard and people do not even agree about how to balance it - e.g. whether the ends justify the means.
-
> More than half of tech workers (53%) would steer a newcomer away from their own field, and they stay.It would be nice to see this survey repeated across professions. In my experience, most people have gripes about their profession because it’s what they know. Only half of respondents saying they would steer newcomers away feels a lot better than…
-
If everyone doing a 'bad thing' stepped off the hamster wheel today, the world economy would collapse before markets closed. The biggest companies have built an attention and surveillance nightmare machine that funnels all the money to a relatively small number of shareholders.
-
> do not consider yourself a contributor to humankindGood lord. You could apply the same logic to any taxpaying resident of any country whose government is doing something bad. There's some truth to it, it's worth bearing in mind, but it's also the very definition of an Isolated Demand for Rigor.
-
Generally, I agree.Imagine: you start working at the company with a good will towards them. As you learn more and see more decisions, you slowly realize how bad it is. Now you've already contributed. Then you leave.It might be possible to build everything with this goodwill and that's how we'd still end up with a torment nexus even if you…
-
Nice to see people standing up for their beliefs even when it could hurt them.Story time :)I remember when I was first starting out as a programmer. At QE (always occurred on a weekend) a slew of financial reports were created and printed for review the following Monday then I think used for summaries for Wall Street to look at.A high level…