
Anthropic
John Hughes is an AI control researcher at Anthropic and previously worked as a machine learning engineer at Speechmatics (Cambridge, UK). He was mentored by Ethan Perez since Summer 2023 when he took part in MATS4. During his time at MATS, he worked on an AI safety via debate paper, which was awarded best paper at ICML 2024. After MATS, he worked with Anthropic as a contractor on jailbreak robustness in a narrow domain, Best-of-N Jailbreaking and why models alignment fake.
2023 年夏季班共有 60 位学员和 15 位导师,研究覆盖 12 个领域。项目包括 4 周远程培训、8 周在伯克利开展的研究,以及 4 个月的延长期。2023 年 9 月,MATS 管理团队共同创立了 London Initiative for Safe AI(LISA),为伦敦的 AI 安全研究者和机构提供专门的研究空间,也让 MATS 学员能够继续推进自己的课题。各领域的项目分布较广:约三分之一聚焦评估和能力展示,五分之一聚焦机制可解释性,其他课题则涉及智能体基础、激活工程和协作式 AI。
John Hughes