本研究将基于我们关于预训练神经网络激活中信念状态几何结构的发现展开。项目可以结合申请者在数学建模和/或机器学习工程方面的优势。我们欢迎积极主动、相对独立的学员:在接受指导的同时,能主导自己选择的相关项目。可能的方向包括研究上下文学习、分布外泛化、从理论角度评估稀疏自编码器(SAE)、设计新的特征发现方法、压缩 Transformer 中表征的方法,以及对强化学习模型开展可解释性研究。
SF Bay Area
Paul Riechers is a researcher and scientific leader with deep expertise in the physics of information and the fundamental limits of learning and prediction. He co-founded Simplex, an AI safety research organization, with Dr. Adam Shai, applying insights from theoretical physics and neuroscience to build foundational understanding of internal representations and emergent behavior in neural networks. Paul earned a PhD in theoretical physics and an MS in electrical and computer engineering from UC Davis. Prior to founding Simplex, he spent five years as a Research Fellow at Nanyang Technological University in Singapore. He is also co-founder of the Beyond Institute for Theoretical Science (BITS), a former Senior Fellow at UCLA’s Mathematics of Intelligences program at IPAM, and has served as both a MATS scholar and mentor. Paul has co-organized multiple workshops on AI interpretability and alignment, and now co-leads the growing Simplex team with support from the Astera Institute.
项目可以发挥申请者在数学建模和/或机器学习工程方面的优势。我们欢迎动力充足、相对独立的学员,在接受指导的同时主导自己选择的相关项目。理想的学员行动迅速,并在研究(例如任意领域的博士训练)或软件/机器学习工程方面拥有经验。
我们会和学员一起讨论研究想法。