我们认为,AI 安全领域需要快速扩大规模,才能确保 AI 的开发与部署顺利进行。MATS 已培养了 10 届优秀研究员,但高影响力组织日益受管理与扩张能力所限。值得推进的想法多于愿意支持它们的综合管理者,可用资金的增长速度也超过了实际部署能力。我们因此推出 MATS 创业与领域建设方向,帮助解决这些瓶颈,推动 AI 安全扩大规模。
我们希望招收善于解决问题、坚持原则,并愿意投入重要工作的研究员。本方向主要有三类发展路径:
如果你觉得这些角色适合自己,欢迎申请!
项目灵感来源包括:Coefficient Giving 2025 技术 AI 安全项目征集、Bio Action Plan、Lizka Vaintrob 与 Owen Cotton-Barratt、Eric Ho、Marius Hobbhahn、Julian Hazell、Abbey Chaver,以及 Asya Bergal。
This stream will focus on field-building and research amplification, including headhunting and talent projects, ecosystem incentives such as large impact bounties, and operational work to scale an alignment research team.
Strong motivation to reduce loss-of-control risks from misaligned superintelligence.
**One** of the following:
1. Impressive experience outside AI safety, for example: successfully scaling a startup as an early hire, 5 years at a top consultancy with above-average progression, or an unusually strong background from a leading tech company.
2. A strong AI safety operational track record, like leading a research fellowship, or talent program.
[Reasoning transparency.](https://coefficientgiving.org/research/reasoning-transparency/)
Founding ambitious AI safety and field-building projects.
Minimum support = 2x 30-min meetings per week. We could scale this up as appropriate.
I'll be based in SF. If the fellows want to work in BlueDot's office for some periods of time, I could collaborate with them daily.
I'm available for quick calls anytime, and am responsive on Slack.
I'm open to people with a wide range of backgrounds. Though you need to be willing to work very hard, be great at communicating, and have a burning desire to make AI go well.
I work best with people who are intense, communicate and reason clearly, and are mission-driven.
We'll work together to design the project. You'll have a lot of freedom to figure out what the best shape of thing to do is, and I'll provide lots of regular feedback and make relevant introductions to help you refine the proposal.
Your first 1-2 weeks will be focused on figuring out what to do, and the rest of the fellowship will be focused on execution.
This stream will focus on biosecurity, behavioral science for AI governance, and evaluating interventions to reduce catastrophic risk.
Eleos AI Research is a nonprofit working to ensure the interests of AI systems are appropriately taken into account as we navigate transformative AI. We are looking for competent generalists to help scale up our AI welfare field-building by running high-impact events, or to otherwise amplify our research, communications, and operational capacity.
By default, I expect to meet with each fellow for at least 60 minutes per week (possibly split into 2 x 30 minute meetings). For projects that require a lot of input (e.g. event organizing), we can scale that up as needed. I’ll also be available for ad hoc meetings, and can be reached asynchronously on Slack or by email. At Eleos, we each post a daily update in Slack; I would like fellows to do the same.
The ideal candidate:
We'll meet at the start of the program to discuss ideas in the areas listed above, as well as ideas that fellows would like to pitch. We’ll jointly decide on a project that aligns with Eleos’s priorities as well as the goals and skills of the fellow.
Backing projects focused on product development and organization building in the areas of AI safety and alignment, biosecurity, and critical cybersecurity. Looking for fellows who are self starters, default to action, and have a desire to create.
Co-mentorship from Halcyon's Ross Matican (Investor & Grantmaker), Mike McCormick (Founder, CEO), and Charlie Petty (Venture Partner). Ross will be leading point.
Scheduled 45 min bi-weekly meetings (every other week). Ad hoc meetings can be added between scheduled sessions. We'll have a shared Slack channel with Ross, Mike, and Charlie, as well as the supporting team at Halcyon. Ping us anytime.
For product development and organization building projects:
For generalist projects:
For product development and organization building projects in the areas of AI safety and alignment, biosecurity, and critical cybersecurity - fellows will have full freedom. We expect fellows to come with rough ideas and opinions on direction that will inform where they start exploring the market. We don’t expect refined ideas or pitches. We do expect building.
For field building and generalist fellows, we are prioritizing a talent matching project. This includes processing thousands of individuals in our CRM, and finding how they may pair with our portfolio companies and other areas of high priority in our network.
MATS 项目是一项为期 10 周的研究奖学金计划,旨在培养和支持从事人工智能对齐、透明度和安全领域工作的新兴研究人员。研究员将与世界一流的导师合作,获得专门的研究管理支持,并加入位于伯克利、致力于推动人工智能安全与可靠发展的活跃社区。该项目提供开展高影响力研究并开启人工智能安全领域长期职业生涯所需的架构、资源和指导。
MATS 导师均为来自人工智能安全、对齐、治理、领域建设及安全等广泛领域的顶尖研究人员。他们包括学术界人士、行业研究员以及独立专家,负责指导学者开展研究项目、提供反馈,并助力每位学者的研究成长。导师们的专业领域涵盖:
查看 往届及现任导师
关键日期
申请:
主项目将于 9 月 28 日至 12 月 4 日进行,获选研究员的延展阶段将于 12 月开始。
MATS 欢迎来自不同学术和专业背景的申请者——从机器学习、数学和计算机科学,到政策、经济学、物理学、认知科学、生物学和公共卫生,同时也欢迎没有传统研究背景的创业者、运营人员和领域建设者。主要要求是具备为人工智能安全做出贡献的强烈动机,并展现出技术能力、研究潜力或相关的运营经验。具备人工智能安全相关经验会有所帮助,但并非必要条件。