AI TrackerGet the app
← All news
OpenAIModels

OpenAI signs four outside groups to assess its models' alignment and safeguards from inside

OpenAI says it has signed agreements with Apollo Research, METR, Transluce and Goodfire for a first phase of "embedded assessments", in which independent experts get deep access to its internal models and systems over an extended period. Access can include model checkpoints, source code, training and evaluation data, monitoring systems and talks with researchers. The first assessments cover alignment and safeguards for models during training and internal use. OpenAI published the announcement on November 13.

  • Apollo Research will test four claims: that training did not incentivize subversion, that evaluations and red teaming do not elicit it, that models have not attempted it in internal use, and that reasoning behind it would be detectable.
  • METR will assess misaligned behavior in OpenAI's largest reinforcement learning run to date. OpenAI says a broader monitor assessment is preliminarily agreed but pending agreement on scope.
  • Transluce will assess the quality and coverage of OpenAI's post-training alignment evaluations. Both sides say they intend a follow-on assessment of about eight weeks in early 2027.
  • Goodfire will embed interpretability researchers to analyze model internals for training-run monitoring, debugging and alignment. Its main audience is OpenAI's own researchers, and it will also publish findings.

OpenAI describes the protocols: assessors who need sensitive information work on site on OpenAI devices; the Safety and Security Committee of the OpenAI Foundation's board gets unredacted reports; staff conversations are off the record, though assessors can request OpenAI-attested statements; and OpenAI keeps the right to redact confidential information and ask for responsible-disclosure delays. It discloses that Apollo Research and Goodfire accept payment, not contingent on results, while METR and Transluce do not, though they may accept API credits or compute.

Get news like this as a push.

AI Tracker alerts you when something changes for the tools you use.

Get the app