Test Automation Engineer - AI Solutions

IndiaIndiaRemoteNormalmid
EngineeringQa Engineer
0 views0 saves0 applied

Quick Summary

Key Responsibilities

Design, develop, and maintain automated test frameworks and reusable test components for functional, interface, integration, regression, and system-level testing.

Requirements Summary

Test GenAI-based functionality, MCP servers and clients, tool integrations, APIs, and interfaces between distributed software components. Validate functional behavior, error handling, reliability,

Technical Tools
EngineeringQa Engineer
If you want to directly shape the future, this is your opportunity. Advantest is one of the world’s leading providers of automatic test equipment for the semiconductor industry. We work closely with leading companies in emerging markets. Almost any modern AI, cloud, or embedded system is based on semiconductor devices that have been tested with our products.
We are looking for a Test Automation Engineer AI Solutions with strong experience in Linux, Python-based test automation, software testing, and testing of AI-based solutions. The role focuses on developing and maintaining automated test environments, defining and executing test strategies, and ensuring the quality and reliability of GenAI applications, MCP-based solutions, interfaces, integrations, and large-scale software applications.
 
Key Responsibilities
• Test automation: Design, develop, and maintain automated test frameworks and reusable test components for functional, interface, integration, regression, and system-level testing. Develop automated tests for GenAI applications, AI agents, and MCP-based solutions.
• Test planning and execution: Translate product requirements into test scenarios and test cases. Maintain test plans and strategies, execute manual and automated tests, analyze results, and track defects through resolution.
• AI, interface, and integration testing: Test GenAI-based functionality, MCP servers and clients, tool integrations, APIs, and interfaces between distributed software components. Validate functional behavior, error handling, reliability, and end-to-end workflows.
• Linux and test infrastructure: Work with Linux-based development and test environments, application configurations, deployment environments, and test infrastructure. Develop automation using Python and Shell scripting and support Docker-based workflows.
• Test results and development integration: Consolidate test results, generate test reports and quality metrics, and improve test coverage and release quality. Work closely with developers, architects, DevOps engineers, and product teams and support release validation.
'Required Qualifications
• Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field, with 3+ years of experience in software testing and test automation.
• Strong experience with Linux, Python, Shell scripting, and automated test frameworks, including manual and automated testing methods.
• Good knowledge of interface, API, integration, end-to-end, and system testing, including testing across distributed software components.
• Experience with Docker, CI/CD and build tools such as Jenkins and Bazel, and source control systems such as Git and Bitbucket.
• Strong understanding of test strategies, test design, defect management, debugging, and troubleshooting, with experience working in Agile/Scrum development environments.
 
Preferred Skills
• Experience testing GenAI applications, AI agents, LLM-based applications, and MCP-based solutions, including MCP servers, clients, tools, and their integration with external systems.
• Knowledge of Advantest V93000 (93K) and SmarTest 8 (SMT8).
• Experience with AI-assisted or AI-native software development workflows.
• Experience testing complex enterprise or distributed applications, including API, interface, integration, and end-to-end testing.
• Exposure to performance and scalability testing, cloud-based test environments, and test reporting or quality dashboards.
• Experience with security testing of LLM applications (e.g. OWASP Top 10 for LLM Applications: prompt injection, insecure tool use, data leakage).
 
Personal Skills
• Strong analytical, debugging, and problem-solving skills.
• Clear communication and effective collaboration with software development teams.
• Ability to work independently, take ownership of tasks, and maintain a strong focus on software quality.
 

Location & Eligibility

Where is the job
India
Remote within one country
Who can apply
IN

About this job

Who can apply
India
Posted
6 days ago
Employer
has 306 open jobs on Jobera in 11 countries.

Listing Details

Posted
November 15, 2026
First seen
November 16, 2026
Last seen
November 21, 2026

Posting Health

Days active
4
Repost count
0
Trust Level
43%
Scored at
November 21, 2026

Signal breakdown

freshnesssource trustcontent trustemployer trust
Newsletter

Stay ahead of the market

Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.

A
B
C
D
Join 12,000+ marketers

No spam. Unsubscribe at any time.

Test Automation Engineer - AI Solutions