Eval Cooperativeness May Be a Scalable Mitigation for Eval Gaming

MATS Fellow:

Jasmine Li

Authors:

Jasmine Li, Alex Turner

Citations

Citations

Abstract:

Behavioral evaluations may become worthless, which we think would be a disaster. Smart misaligned models may realize they are being evaluated (“eval awareness”) and then act to look good to us so we don’t realize they’re misaligned (“eval gaming”). We think increasing eval cooperativeness might be a more scalable solution to eval gaming than reducing eval awareness.

Recent research

Frequently asked questions

What is the MATS Program?
How long does the program last?