Sep 18, 2026 Announcements Partnering with Accenture on embedded evaluation

摘要
这条新闻已抓取入库,中文摘要正在生成中。你可以先打开原文查看完整内容。
原文译文
以下为抓取到的原文内容译文,已统一为站内阅读格式。
Partnering with Accenture on embedded evaluation
Partnering with Accenture on embedded evaluation
We're partnering with Accenture on independent evaluation of frontier AI. This is an important step toward the commitment, made in our CEO’sessay“We Must Pace the Frontier,” to embed evaluators within Anthropic.
The partnership will be led by Faculty, Accenture’s specialist AI business, and will include evaluating and red-teaming models, conducting alignment assessments, and testing model safeguards. Accenture helps businesses and governments deploy AI across many industries. Their understanding of how enterprises use AI in practice informs their safety approach, and they will bring that perspective to evaluating our models.
Anthropic and Accenture each expect to invest at least $1 billion in building capacity in this area over the next five years.
Embedded evaluation is new, and many of the details about how it will operate are still being worked out. Unlike today’s external evaluators, embedded evaluators will work inside AI companies, with access comparable to an employee's. That access allows them to watch models take shape in training, follow the decisions that govern how those models are built and deployed, and speak directly to employees. From this vantage point, embedded evaluators can assess how a company operates, verify that it is keeping its safety commitments, and identify blind spots. They can also report incidents and give the public a more informed account of benefits and risks.
To be clear, independent embedded evaluators do not reduce our accountability, but help to make it more verifiable. The safety of our models remains our responsibility.
There are, as yet, no standards for what information embedded evaluators should have access to, or how they should report what they find. There is also no settled system for funding independent evaluation. Long-term, we think funding should come from pooled or government sources, as we called for in ourAdvanced AI Frameworkin June. As neither exists today, we plan to work with different evaluators under different funding arrangements.
Given the importance and urgency of this work, Anthropic will fund Accenture's work directly. We are also in dialogue withMETRand other nonprofit evaluators to pilot elements of embedded evaluation using their own funding. Ultimately, we believe frontier AI needs an ecosystem of evaluators operating with shared standards.
We expect frontier labs to work with several organizations at once. Our partnership is non-exclusive; Anthropic will work with other evaluators to be announced in the coming weeks, and Accenture will work with other AI developers in similar capacities.
We'll continue to train and release frontier models, and we want independent evaluators working alongside us as we do. We’re sharing these early efforts now so people and other AI developers can see our process. We expect our approach to evolve as the field matures, and we’ll share more as our work begins and as we bring on additional evaluators.
来源地区
United States
热度分
68
分类
研究进展
语言
en
