
Timaeus
Jesse Hoogland is the executive director of Timaeus, an AI safety research organization studying developmental interpretability and singular learning theory. He was a MATS scholar during MATS 3.0 and 3.1 in Evan Hubinger's Deceptive AI stream. During this period, he became interested in understanding how AI systems develop during training. This led to him helping to organize the SLT and Alignment conference and the DevInterp conference, which resulted in the developmental interpretability research agenda.
2022—2023 年冬季班共有 58 位学员和 17 位导师,导师来自 Anthropic、MIRI、ARC、Redwood Research 等领先机构。本届首次设立 Scholar Support 团队,为学员提供研究指导,并协助他们解决研究过程中的障碍。项目先在线开展 6 周,随后在伯克利线下进行 2 个月。学员还组织了多种活动,包括机制可解释性和线性代数学习小组、每周闪电演讲,以及研究工具和技术写作工作坊。本届校友中,Marius Hobbhahn 创立了 Apollo Research 并发表了机制可解释性研究;Asa 与他人合著了关于测量情境意识以及大型语言模型“反转诅咒”的论文;Jesse Hoogland 创立了 Timaeus,并提出了发展式可解释性研究方向。
There's life pre-MATS and life post-MATS. It was the inflection point that set me up to become a technical AI safety researcher. I don't think there are other opportunities as good at getting early-career people integrated into AI safety. The in-person program was the most impactful and high-energy two months I've ever been a part of, and it's my number one recommendation to people considering work on AI safety.
Jesse Hoogland