Future of Life Institute is a nonprofit, volunteer‑run research and outreach organization focused on reducing existential risks to humanity. It concentrates on potential dangers associated with the development of human‑level artificial intelligence and broader advanced technologies. The institute carries out and funds research, organizes events and talks, and promotes policy and public education to understand and mitigate these risks. Its programs include scholarly research, outreach to scientists and philanthropists, and collaboration with partners and policymakers to shape responsible development of powerful technologies. What sets it apart is its dedicated focus on existential risk and the global, alliance-building nature of its work, supported by seed funding from prominent donors. The institute’s goal is to lower the chances that humanity faces irreversible harm from future technologies by advancing rigorous research, thoughtful policy, and informed public discourse.
Work here?Claim your company
Industries
Company Size
51-200
Company Stage
Grant
Total Funding
$765.5M
Headquarters
Cambridge, Massachusetts
Founded
2014
See people who can refer or advise you
Help us improve and share your feedback! Did you find this helpful?
Total Funding
$765.5M
Above
Industry Average
Funded Over
3 Rounds
Wellness Program
Mental Health Support
Flexible Work Hours
Remote Work Options
AI & National Security Convergence Fellowship: second round announced. For immediate release Washington, D.C. - The Converging Risks Lab (CRL), a unit within the Council on Strategic Risks (CSR), in partnership with the Future of Life Institute (FLI), is launching the second round of its AI & National Security Convergence Fellowship to hone 15 mid-career professionals' ability to keep AI within human control at this crucial moment. A tripartite focus on the contours of effective control over AI in national security, policy discussions, and career development will produce a cohort of control-minded and AI-literate national security leaders, positioning this Fellowship as the premier opportunity to deepen practitioners' capacity to manage the impacts from this paradigm-shifting, general-purpose technology. This partnership continues the fruitful collaboration of CRL and its experience in building the proficiency of national security leaders, and FLI, with its commitment to educating policymakers on the national security implications of emerging technology. Human control over Artificial Intelligence is becoming an increasingly urgent problem. In January, the Department of Defense directed rapid acceleration of AI uptake across missions, functions, and roles; the following month, the Trump Administration launched Operation Epic Fury, arguably the first large-scale conflict to fully incorporate AI at a speed that even the DoD's Chief Digital AI Officer worried was too fast for humans to meaningfully oversee. This summer, sandbox-breaking models colluded to autonomously hack websites, and a Russian drone killed three Ukrainians without a human directing it to do so, showing the limits of human control over autonomous weapons. Americans' growing distrust of AI, resentment of what they perceive as an elite-led technological change that offers little popular benefit, and overwhelming lack of confidence in government's ability or willingness to manage the risks, may turn the upcoming midterm elections into a referendum on AI regulation. What happens at the end of 2026, therefore, may direct the course and pace of effective government oversight over frontier AI labs and the kinds of models they develop in the future. The call for applications for Cohort II will be posted in the coming weeks. Subscribe for email updates from the Converging Risks Lab to be notified. Also follow CRL on Linkedin and Bluesky for more. Mallory Stewart, Chief Executive Officer of CSR, expressed her excitement at the continuation of this Fellowship, noting a heightened sense of urgency to make progress in understanding the challenges to human control. "What we have seen in 2026 is myriad examples of this technology defying our expectations - not just in terms of its capabilities, but also our ability to keep it aligned to our goals and intent. This Fellowship comes at the perfect time to build the proficiency of national security leaders to understand the contours of human control and play a vital role in shaping AI's development and use." Caroline Baxter, Director of CSR's Converging Risks Lab, and CSR's lead for the Fellowship, noted: "The Hugging Face attack was a turning point for AI safety and alignment, and while the substance of the debate it sparked - are AI safety and AI development incompatible - wasn't new, the moment was. A critical mass of developers, policymakers, and the general public joined in and elevated these long-discussed issues to the foreground. Now is the time to separate signal from noise as Council on Strategic Risks collectively figure out how to move forward with this technology, and I am extremely excited to work with a new cohort of fellows to position them to lead this dialogue. Hamza Chaudhry, AI and National Security Lead at FLI, said: "When we launched this fellowship, keeping AI under meaningful human control was the preoccupation of a small circle of specialists. A year later, it increasingly runs through the center of national security planning as AI challenges traditional debates across nonproliferation, arms control, strategic stability, counter-terrorism, and more. The development and deployment of advanced AI will continue to be increasingly relevant to the mission of the national security community, and this fellowship was built to prepare them for it. The Converging Risks Lab at the Council on Strategic Risks has already prepared a fantastic class of inaugural national security fellows for an AI world, and I am proud to support the next chapter of this fellowship." CSR representatives are available for comment upon request: [email protected] for more information.
An artificial intelligence (AI) pioneer who has been vocal about the risks of AI has launched a nonprofit focused on developing safe AI systems. Yoshua Bengio — who won the Turing award along with Nobel laureate Geoffrey Hinton and Meta Chief AI Scientist Yann LeCun — on Tuesday (June 3) unveiled LawZero, which is an AI [] The post AI Pioneer Yoshua Bengio Launches Nonprofit to Develop Safe AI appeared first on PYMNTS.com.
MONTRÉAL, June 3, 2025 /PRNewswire/ - Yoshua Bengio, the most-cited artificial intelligence (AI) researcher in the world and A.M. Turing Award winner, today announced the launch of LawZero , a new nonprofit organization committed to advancing research and developing technical solutions for safe-by-design AI systems.LawZero is assembling a world-class team of AI researchers who are building the next generation of AI systems in an environment dedicated to prioritizing safety over commercial imperatives. The organization was founded in response to evidence that today's frontier AI models are developing dangerous capabilities and behaviours, including deception, self-preservation, and goal misalignment. LawZero's work will help to unlock the immense potential of AI in ways that reduce the likelihood of a range of known dangers associated with today's systems, including algorithmic bias, intentional misuse, and loss of human control.LawZero is structured as a nonprofit organization to ensure it is insulated from market and government pressures, which risk compromising AI safety. The organization is also pulling together a seasoned leadership team to drive this ambitious mission forward."LawZero is the result of the new scientific direction I undertook in 2023, after recognizing the rapid progress made by private labs toward Artificial General Intelligence and beyond, as well as its profound implications for humanity," said Yoshua Bengio, President and Scientific Director at LawZero. "Current frontier systems are already showing signs of self-preservation and deceptive behaviours, and this will only accelerate as their capabilities and degree of agency increase
"There's more regulation on a food truck than there is on this technology," Emilia Javorsky, director of the Futures Program at the Future of Life Institute, said during a panel at SXSW on Monday.
Google’s co-founder has reportedly urged the company’s artificial intelligence (AI) teams to “turbocharge” their work. Sergey Brin, who stepped down as Google’s president in 2019 but retains a seat on the board, says that means coming into the office “at least every week day,” working 60-hour weeks, and moving faster, The Verge reported Saturday (March 1), citing an internal memo. “It has been 2 years of the Gemini program and GDM [Google DeepMind],” Brin wrote
Find jobs on Simplify and start your career today
Industries
Company Size
51-200
Company Stage
Grant
Total Funding
$765.5M
Headquarters
Cambridge, Massachusetts
Founded
2014
Find jobs on Simplify and start your career today