Canada, Germany fund Bengio's LawZero with $300M for safe AI research
The non-profit will use the grant to develop Scientist AI, a system designed to monitor and guard against harmful AI behaviors.
What to know
- Canada and Germany are jointly providing $300 million ($150M each) in grants to LawZero, a non-profit developing safe AI systems, announced at Montreal's All In AI conference on September 16.
- The funding will support development of Scientist AI, a guardrail system designed to monitor other AI models and prevent harmful behaviors like deception, self-preservation, and goal misalignment.
- Bengio frames the investment as a way for middle powers to shape global AI governance and ensure the technology's future is not determined solely by the U.S. and China.
- The announcement aligns with broader industry calls for slower, safer AI development, following recent warnings from researchers about existential risks and Anthropic CEO Dario Amodei's essay this month on coordinated pacing.
“Middle powers like Canada, as Mark Carney has been saying, need to have cards in their hands so that they can sit at the global table and be part of the discussion. So the future of humanity and geopolitical power isn't the decision of two countries.”
Yoshua Bengio, LawZero founder · Globe and Mail ↗ · Sep 15
Yoshua Bengio Founder, LawZero; Turing Award winnerLawZero Non-profit AI safety organizationCanada (Federal AI Minister Evan Solomon) Co-funderGermany Co-funder
Dario Amodei Anthropic CEO
How it unfolded 1 development · click the chart to see its coverage articlesposts
-
1
Canadian AI minister frames funding as sovereignty and geopolitical positioning
Federal AI minister Evan Solomon and Bengio both emphasize that the funding allows Canada to strengthen sovereign AI capacity and ensure that middle powers have a voice in shaping the technology globally, rather than ceding the field to the U.S. and China.
“By investing in homegrown innovation like Scientist AI, we are strengthening Canada's sovereign AI capacity and ensuring that the next generation of AI is built safely, responsibly, and on Canadian terms.”
— Evan Solomon -
background
Canada and Germany commit $300M in grants to LawZero — LawZero announces at Montreal's All In AI conference that Canada and Germany will each contribute up to $150 million in grant funding. The financing will support hiring and computational costs for developing Scientist AI, a system designed to monitor and create guardrails for other AI systems.
-
background
Anthropic CEO Amodei calls for coordinated AI development slowdown — Dario Amodei publishes an essay this month arguing that AI companies should work together to pace the speed of development, echoing earlier calls from Bengio and others for restraint.
-
background
Yoshua Bengio founds LawZero non-profit with $30M philanthropic funding — Bengio, a Turing Award winner and professor at Université de Montréal, establishes LawZero with close to US$30 million in philanthropic funding after becoming concerned that powerful AI systems could be misused and slip from human control.
-
background
Bengio signs open letter calling for AI development pause — Bengio becomes one of signatories to an open letter arguing for a pause on AI development to allow guardrails to be put in place, following concerns about misalignment and harmful traits in AI systems.
Also covered reported alongside — the timeline has no entry for these yet
-
first by Globe and Mail, 11d ago · also The Globe and Mail
1 more headline
- Yoshua Bengio’s non-profit to get up to $300-million from Canada, Germany to expand safe AI development The Globe and Mail · 10d ago
-
first by The Logic, 11d ago · also BetaKit
1 more headline