AI Engineer, Evaluation - 11319

India·BangaloreRemoteMid Levelmid

Machine Learning EngineerData

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

Technical Tools

pythonab-testingci-cddata-visualizationstatistical-modeling

Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins.

Why join Coupa?

🔹 Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend.

🔹 Collaborative Culture: We value collaboration and teamwork, and our culture is driven by transparency, openness, and a shared commitment to excellence.

🔹 Global Impact: Join a company where your work has a global, measurable impact on our clients, the business, and each other.

Learn more on Life at Coupa blog and hear from our employees about their experiences working at Coupa.

The Impact of a AI Engineer, Evaluation & Quality at Coupa:

Coupa's AI platform serves thousands of enterprise customers, and model quality directly impacts business outcomes. The AI Engineer, Evaluation & Quality will build the evaluation infrastructure that ensures our AI models meet rigorous accuracy standards. You will design benchmarks, implement automated evaluation pipelines, and build dashboards that track model performance across iterations.

Build and maintain automated evaluation pipelines for AI model quality.

Implement task-specific benchmarks and test suites.

Design quality dashboards tracking accuracy, regression, and safety metrics.

Implement automated regression testing for every model iteration.

Build comparison frameworks for side-by-side evaluation of model variants.

Analyze evaluation results to identify failure modes and report to the ML team.

Maintain evaluation datasets: versioning, quality validation, coverage analysis.

Support A/B testing infrastructure for production model validation.

3+ years of software engineering

Proficiency in Python .

Experience with statistical analysis and data visualization.

Understanding of ML model evaluation concepts (precision, recall, F1, human eval).