Lead Software Development Engineer in Test - AI
Quick Summary
At least 7 years of professional experience in Quality Assurance (QA), Software Development Engineering in Test (SDET), or related software testing roles. Deep expertise in AI tools and model testing,
As a Lead Software Development Engineer in Test, you will take ownership of quality engineering strategy across a rapidly evolving AI-driven product ecosystem. You will define and implement scalable testing approaches, architect reusable automation frameworks, and establish quality standards that support reliable and high-performing AI solutions. A key focus will be evaluating AI models and tools, addressing challenges such as hallucinations, retrieval accuracy, model drift, and algorithmic bias. You will drive organization-wide quality initiatives while collaborating closely with engineering, product, and architecture teams. In addition to providing technical leadership, you will mentor and develop engineering talent, promoting best practices and continuous improvement. This is an opportunity to shape the long-term AI quality roadmap within a global, remote-first, and innovation-driven technology environment.
-
Define and lead the overall Quality Assurance (QA) strategy for AI products and engineering initiatives.
-
Architect, develop, and implement large-scale, reusable, and cross-platform test automation frameworks.
-
Take end-to-end ownership of the quality charter for the AI vertical, ensuring consistency, reliability, scalability, and performance across products.
-
Drive organization-wide quality engineering initiatives and establish standardized testing methodologies and best practices.
-
Design and implement scalable testing strategies for AI-powered systems, covering Retrieval-Augmented Generation (RAG), hallucinations, model drift, bias, and other AI-specific quality challenges.
-
Establish testing approaches that evaluate AI model behavior, accuracy, reliability, and consistency under different scenarios and operating conditions.
-
Own key technical decisions related to test strategies, automation tools, frameworks, and AI testing methodologies.
-
Shape and execute the AI quality roadmap, identifying opportunities to reduce technical risks and improve product reliability and scalability.
-
Collaborate with cross-functional teams, including Software Engineering, Product, and Architecture, to align quality initiatives with technical and business objectives.
-
Participate in architectural discussions and influence engineering decisions to ensure quality is integrated throughout the software development lifecycle.
-
Lead, coach, and mentor the QA/SDET team, strengthening technical capabilities and encouraging continuous learning.
-
Establish engineering standards, promote knowledge sharing, and support the development of a strong technical talent pipeline.
-
Monitor quality metrics, identify systemic risks, and implement continuous improvement initiatives across the AI product ecosystem.
Requirements
~2 min read-
At least 7 years of professional experience in Quality Assurance (QA), Software Development Engineering in Test (SDET), or related software testing roles.
-
Deep expertise in AI tools and model testing, with demonstrated experience designing testing strategies for complex AI-powered applications.
-
Strong understanding of AI-specific testing challenges, including Retrieval-Augmented Generation (RAG), hallucination detection, model drift, bias evaluation, and model reliability.
-
Proven experience architecting and implementing large-scale, reusable, and cross-platform test automation frameworks.
-
Strong technical leadership capabilities, with experience mentoring engineers, developing team expertise, establishing best practices, and building high-performing teams.
-
Demonstrated ability to influence cross-functional stakeholders and contribute to technical and architectural discussions.
-
Strong problem-solving and analytical skills, with the ability to independently make decisions regarding testing strategies, tools, frameworks, and AI quality methodologies.
-
Experience defining and managing end-to-end quality strategies at the product or organizational level.
-
Excellent communication and collaboration skills, with the ability to translate complex technical challenges into actionable quality initiatives.
-
A proactive and strategic mindset, with the ability to balance technical execution, team development, and long-term quality objectives.
-
Experience with Continuous Integration and Continuous Delivery (CI/CD) pipelines and cloud platforms such as AWS, Google Cloud Platform (GCP), or Microsoft Azure is an advantage.
-
Familiarity with Machine Learning Operations (MLOps) pipelines and monitoring systems for AI-powered applications is a plus.
-
Exposure to performance, load, and scalability testing of AI workloads is desirable.
What We Offer
~2 min readLocation & Eligibility
About this job
- Who can apply
- India
- Posted
- Today
Listing Details
- Posted
- November 11, 2026
- First seen
- November 11, 2026
- Last seen
- November 11, 2026
Posting Health
- Days active
- 0
- Repost count
- 0
- Trust Level
- 68%
- Scored at
- November 11, 2026
Signal breakdown
4 other jobs at
View all →Similar Software Engineer jobs
View all →Browse Similar Jobs
Stay ahead of the market
Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.
No spam. Unsubscribe at any time.