Mindtickle6mo ago

Software Development Engineer in Test- 1

PuneFull-Timemid

OtherSoftware Development Engineer In TestSdet

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

Who we are Mindtickle is the leading AI-powered revenue enablement platform that combines on-the-job learning and deal execution to drive behavior change and get more revenue per rep.

Technical Tools

OtherSoftware Development Engineer In TestSdet

Who we are

Mindtickle is the leading AI-powered revenue enablement platform that combines on-the-job learning and deal execution to drive behavior change and get more revenue per rep. Mindtickle is recognized as a market leader by top industry analysts and is ranked by G2 as the #1 sales onboarding and training product.

Our commitment to innovation has also earned us the "AI-based Sales Solution of the Year" award in the 8th annual AI Breakthrough Awards program (PR Newswire), and a Gold Stevie Award for Sales and Customer Service (Mindtickle)- recognition of our dedication to both product excellence and outstanding customer support.

Design, build, and maintain scalable automation frameworks to qualify projects pre- and post-release, ensuring consistent product quality.

Develop comprehensive automated test suites (unit, integration, regression, and system-level) and improve CI/CD pipelines for reliable, repeatable releases.

Build scalable testing systems, generate test data, and ensure ongoing quality through automated regression and synthetic monitoring.

Work on test automation frameworks to qualify AI-driven features from LLM-based applications to agentic AI systems.

Develop and test LLM-powered features, including prompt pipelines, retrieval systems, and AI-assisted workflows.

Build and maintain evaluation frameworks to measure quality, factual accuracy, relevance, bias, and hallucination rates.

Conduct robustness, safety, and adversarial testing for AI systems, implementing prompt regression testing, embedding validation, and model reliability/performance tracking.

Improve quality engineering aspects (e.g., testability, shift-left practices) and measure/improve Developer Experience (DevEx).

Collaborate closely with developers and product managers, participating in design discussions and code reviews to ensure every feature and workflow delivers exceptional reliability and performance.

2+ years of experience as a Software Engineer or SDET, with a strong foundation in automation systems.

Proficiency in Go, Java, or Python.

Hands-on experience with LLM APIs and pipelines (OpenAI, Anthropic, Hugging Face).

Experience integrating automation into CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI).

Strong skills in API testing, version control (Git), and containerization (Docker).

Familiarity with cloud platforms (AWS, GCP, Azure AI).

Clear communication and collaboration skills across engineering, ML, and product teams.

Experience in prompt engineering, embeddings, RAG, and LLM evaluation metrics is preferred