New IT Roles Emerge To Tackle AI Evaluation
CIO, Friday, February 27th, 2026
Some organizations are building evaluation teams as they find surprising outputs from decision-making agents that passed initial tests.
New IT jobs are emerging to help organizations better evaluate AI outputs as they move from AI pilots to full-scale deployments.
Many organizations are now considering assembling or hiring AI evaluation teams, with some experts calling these recently created roles an essential safety net for companies rolling out AI tools.
The rapid rise of AI agents is spurring this trend, with AI evaluation teams beginning to take shape in recent months, says Yasmeen Ahmad, managing director of product management, data, and AI cloud at Google Cloud.