Safe AI Forum
International coordination to reduce frontier AI risks, with a focus on China and the West.
研究小组概览
There are several clusters of work that scholars could work with us on.
- US-China interstate coordination on frontier AI safety. Projects in this vein could include (a) researching and developing specific proposals for international agreements that could reduce frontier risks, (b) research that advances understanding of how advanced AI and AGI will affect geopolitics, (c) research that increases the likelihood of successful coordination (e.g., verification of AI agreements)
- Collaborative frontier AI safety and governance research projects with international experts. These include topics such as frontier AI regulation and loss of control threat modelling. This would likely involve joining an ongoing project and contributing to it rather than starting an independent project.
- Horizon scanning and identifying other possible topics for coordination between China and the West.
SF Bay Area
导师
Fynn Heide 是 Safe AI Forum 的执行主任。此前，他在 Centre for the Governance of AI 担任研究学者，研究中国的 AI 政策。
Isabella 是 Safe AI Forum 的高级研究员，致力于推动中美在前沿 AI 安全领域的协调。她的研究重点是技术治理，尤其是促进共识、围绕失控和极端滥用风险开展对话。近期工作涉及技术层面的滥用防护措施、AI 控制行动手册，以及不对齐事件。她拥有 University of Chicago 计算社会科学硕士学位和 University College London 哲学、政治与经济学学士学位。
Saad Siddiqui 是 Safe AI Forum 的高级研究员，研究主要 AI 大国之间达成协议的可能性。此前，他曾在新加坡的 Bain & Company 担任管理顾问。
我们希望招收的学员
Good understanding of international AI governance developments that are relevant to frontier AI safety (e.g., the Summit series, AISI network)
Good understanding of Chinese AI governance and safety (key players, key trends and institutional structures)
Good understanding of key frontier risk domains (CBRN, cyber, loss of control)
Some understanding of broader US-China relations and how they frame US-China relations on AI/AGI specifically
项目遴选
We will provide a shortlist of projects that we are keen for the scholar to work on in Week 1. We'll ask scholars to scope these in the 1st week and make a determination about which project to focus on in Week 2.