Staff Product Manager (Evals)

Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise MCP and trusted by 50% of the Fortune 500, Workato’s cloud-native architecture connects every application, data source, and process to power real-time orchestration at scale. With enterprise-grade security and continuous innovation at its core, Workato provides the trusted foundation for organizations to automate with confidence and operationalize AI across the business. To learn more, visit www.workato.com

We're looking for a Staff Product Manager to own evaluations for AI agents at Workato — both the internal framework that helps our teams ship better AI features, and the customer-facing tools that let builders assess and improve the agents they create. This is a role with a dual mandate. Internally, you'll establish how Workato evaluates agent quality, starting with Agent Studio and expanding to other teams shipping AI capabilities. Externally, you'll build the evaluation experience that helps business technologists understand why their agents succeed or fail — and what to do about it. The right person for this role has actually written evals. You've built test suites, designed evaluation criteria, and debugged agent failures in the trenches. You know the gap between "eval theory" and "eval reality," and you can translate that practitioner knowledge into products that work for both technical teams and non-technical builders.

In this role, you will also be responsible to:

• →

  Define and own the evaluation framework for Workato's internal AI agent features, driving adoption across teams starting with Agent Studio

• →

  Build the customer-facing evaluation experience — how builders test, measure, and improve agents they create on Workato

• →

  Make hard calls about what evaluation complexity to expose versus abstract, balancing rigor with approachability

• →

  Partner closely with the Build Experience PM to ensure evaluation is integrated into the builder journey, not bolted on

• →

  Work with ML engineers and platform teams to ground the framework in technical reality while keeping it accessible

• →

  Establish metrics for what "good" looks like — both for internal agent quality and for customer evaluation adoption

• →

  Spend significant time with customers understanding where they struggle to assess agent performance and what mental models they bring

• 7+ years in Product Management

• Hands-on experience writing evaluations for AI/ML systems (agents, LLMs, or similar)

• Track record of shipping technical products to both internal and external users

• Experience driving adoption of frameworks or practices across engineering teams

• Strong written and verbal communication skills

• Bachelor's degree or equivalent experience