Commenters challenge Anthropic's biology-research gatekeeping
5 Sep 14 5:59 PM · 13d ago · 6 comments · 1 source · development 5 of 5
A commenter identifying as a biologist pushes back on the post's claim that Anthropic restricts biology-related model use for outsiders while running its own research effort.
“It would all be more convincing if the incidents so far didn't seem to be facilitated by an outrageous level of negligence.”
zmmmmm, HN commenter · hn ↗
Dario Amodei Anthropic CEO0x5FC3 Author of the 'Dario, Please' blog postAnthropic AI lab, subject of the critiqueOpenAI Rival frontier AI lab named in the critiqueLina Khan Former FTC Chair
The whole story articlespostscomments the bright band is this development · numbered dots are the others · click one to jump
What people said 24 voices · best of 32 · verbatim
-
M
Good post on the fear mongering from Anthropic and OpenAI: https:// pop.
-
I am a real American, you can read my posts on here going back to 2005. You can look at my real businesses. If you read my posts, you will see I am a Libertarian / right wing Republican who strongly opposes government interference of all kinds. BUT, I do support government regulations on people building biological superweapons to kill all of us…
-
It's important to keep in mind that articles like this one and many more were written exclusively as PR pieces. They were not written for the people on this forum. They are not column pieces, blog posts to share thoughts, or call to actions. The sole purpose was to get the media talking about the article so that the general public view Dario et…
-
This is a pretty difficult read, in no small part because the author’s frustration with the frontier labs has become a bilious, delusional cynicism that leads him to see dog whistling and obfuscation even in cases where Amodei plainly intends for every reader to see his meaning.Anyway,> Dario in as many words, asks for regulation/ban on open…
-
For persistence, I think the most glaring gap is the inference - if these rogue agents need to call Claude's API, then they aren't persistent - Anthropic can turn them off. A memory resident program needs disk to be persistent, but above all it needs CPU; without it there are only bits.And so the implication is the swarm has access to enough local…
-
The US can and has classified inventions and patents deemed "a risk to national security" under the invention secrecy act [0]. A 1971 leak has shown that [1]:> solar photovoltaic generators were subject to review and possible restriction if the photovoltaics were more than 20% efficient. Energy conversion systems were likewise subject to review…
-
The problem about AI censorship is that, you can't preform bans without also create privileges at the same time. Sure, you can censor your AI to provide a "safe" version to the public, but someone will have the access/privilege to the uncensored version.What stops the CEOs or even employees of the AI firms from creating something harmful such as…
-
>Anthropic gates usage related to biology and related research. In their latest threat intelligence report they talk about how they detected and banned bad actors using the Claude line of models to do some scary stuff. Credit to them, this is a slippery slope and they seem to do a good job of detecting and banning misuse. But squint at what is…
-
Regulation got outpaced by technological development around 2023, as evident by the every AI regulation since being 2-3 years behind and having to be amended and resubmitted.Whatever you try to make laws for now will be irrelevant in 1-2 years. You either have to go extremely broad, like the EU does it, and accept that people will find loopholes…
-
At this point, isn't the pause inevitable or wise? A huge section of the population, normal people, have been exposed to the idea that there is this is existential threat. It's escaped containment. They're still processing it but I expect the general reaction from it going main stream is going to be very bad. The pause at this point could be good…
-
there is no accountability for companies, it's not a new thing.3M polluted groundwater in Minnesota for 50 years[1]; Nestlé misled mothers in order to make them stop breastfeeding and switch to their formula which killed babies [2]; Both copmanies are still doing business today.[1]: https://en.wikipedia.org/wiki/3M_contamination_of_Minnesota_…
-
You know the proverb "If you owe the bank $100, that's your problem. If you owe the bank $100 million, that's the bank's problem"Same thing here - If they build it and it does $100 in damages (and we arrest them for it), that's their problem. If they build it and it does $100B in damages, that's everyone's problem. Even if they do get arrested…
-
It would all be more convincing if the incidents so far didn't seem to be facilitated by an outrageous level of negligence.We had OpenAI "accidentally" run an entire swarm of 10,000 agents apparently for weeks, on a security related task, seemingly totally unsupervised, hacking all over the internet - all the conversations were completely visible…
-
It's really frustrating that Dario acts as if he's not the CEO of one of the world's most advanced AI companies. He can just slow down his own company. Of course he doesn't want that. He wants to slow down other companies, but not his own.Also, regarding the incidents: Neither he nor Sam Altman takes responsibility for those incidents. You can't…
-
Yes lets not control Open Weights etc.But come one don't repeat stuff like this:"Remember this man has been saying software development will be solved in “6-12 months” forever now."Don't downplay if people get timelines a little bit wrong. No one could even imagine a system writing and analysing code just a few years back.These people are trying…
-
I'd be curious to see how NVIDIA would suffer if there were a legitimate slowdown to AI development. NVIDIA is the biggest catalyst and winner of speed in the market. Compute needs AI and AI needs compute, so there's definitely going to be an interesting push and pull between chipmakers and AI model companies with regards to regulation. While…
-
> Impressive? Sure. But you trained “Cyber” versions of LLMs and hyped them. How much more impressive is this, compared to developing GTA-clones one shot? Not much more.Such a well written piece.Have you seen the US military budget? When you run a war empire you frame problems as a war on something. That's the way to get around the valuation…
-
> I don’t know what freedom and democracy have to do with AI and the frontier labs. Unless of course Dario is a fan of Neon Genesis Evangelion and dreams of govts run by the three magi. Freedom and democracy for $200 does sound enticing, I won’t lie.Well, every human will become an ecosystem. Human + 500 agents as advisors. (In the case of…
-
> The actual impressive thing is OAI did not detect or stop this attack for close to ten weeks. That is honestly appalling. This is weaponised levels of incompetence.Step 1: Break the law.Step 2: Reframe your incompetence as a struggle against a futuristic force of nature and an ethic/societal question that a legion of pundits can vibesplain their…
-
I think Anthropic just have no legitimacy to being the stewards of AI. They don't have a good track record. They are a private company without any governence that puts my interests into the equation. I am not US-based, thus I can't democratically influence them. Why should I want some batshit crazy, US-based technocrats deciding what I can and…
-
> Now to cause hundreds of billions of dollars in losses. I’d say the straightforward way is just do what the ransomware gangs do. Voila. Yeah, not in 6 months, not in 12 months. Never.I think this fails to account properly for how much financial damage it would do simply just having the entire Internet be effectively unusable for an extended…
-
Presumably OAI and HuggingFace reached some sort of mutually acceptable arrangement outside the court system. That's how torts work; you injure someone, you owe them. But just them.When an AI bot injures you, you can call the owner to account. But not until then. You have no standing to demand "accountability".
-
It all comes down to " Privatize profits, socialize losses." It's the American way.Here it is: "We warned you you should have regulated us! Now this mess is your fault and responsibility!"Previously (~2008) it was "We're too big to fail, save us to save the economy!"
-
I think the most realistic analogy I can think of is the financial sector. A few large banks/hedge funds blow up due to unregulated greed/ambition, damage is socialized, regulations are put in place, and then chipped away at over a few years and everyones back to where they started.
All 5 developments of HN blog post 'Dario, Please' rips into Amodei's call to… →
Hacker NewsMastodonNewswiresReddit