18d ago

Senior Quality Automation Engineer – AI/LLM

senior

EngineeringAutomation Engineer

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

DARE TO BE A PART OF THE CHALLENGE! COME AND JOIN OUR TEAM TOGETHER WE CAN MAKE THE DIFFERENCE!

Technical Tools

EngineeringAutomation Engineer

We are looking for an experienced Senior Quality Automation Engineer – AI/LLM to join a collaborative team working on modern AI-enabled solutions. This role will partner closely with Product, Engineering, Architecture, and Business Subject Matter Experts to define measurable quality criteria, build automated testing and evaluation suites, and provide independent evidence to support release-readiness decisions.

The ideal candidate has a strong background in quality engineering and test automation, along with practical experience testing LLM, RAG, conversational AI, or agent-based solutions. Deep expertise in every AI evaluation tool is not required; we are looking for someone with solid automation fundamentals who can apply them effectively in AI-driven environments.

Requirements

~1 min read

6+ years of experience in Software Quality Engineering, SDET, or Test Automation.
2+ years of hands-on Playwright experience.
Strong TypeScript or JavaScript skills.
Hands-on experience with Python test automation and pytest or comparable frameworks.
Practical experience testing LLM, RAG, conversational AI, or agent-based solutions.
Experience with REST APIs, JSON, OpenAPI, UI/API automation, and service integrations.
Experience integrating automated tests into CI/CD pipelines, preferably Azure DevOps.
Experience with Git-based development workflows.
Knowledge of AI-specific failure modes such as hallucination, grounding failure, prompt injection, unsafe tool use, and retrieval or permission defects.
Ability to translate requirements and acceptance criteria into risk-based test scenarios and traceable quality evidence.
Experience collaborating with Developers, Architects, Product Owners, and Business SMEs to investigate failures and provide release recommendations.
Strong written and verbal communication skills.

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com

Declaración de igualdad de oportunidades en el empleo

Creemos que nadie debe ser discriminado por sus diferencias. Todas las decisiones de empleo se tomarán sin importar la edad, raza, credo, color, religión, sexo, origen nacional, ascendencia, discapacidad, condición de veterano militar, orientación sexual, identidad o expresión de género, información genética, estado civil, ciudadanía ni ningún otro criterio protegido por la legislación aplicable. Nuestra rica diversidad nos hace más innovadores, competitivos y creativos, lo que nos ayuda a servir mejor a nuestros clientes y comunidades.