Senior QA Automation Engineer

Colombia·BogotáRemoteQuality Assurancesenior

EngineeringQa Engineer

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

We are looking for an experienced Senior QA Engineer to own quality for our AI voice virtual agent.

Technical Tools

EngineeringQa Engineer

We are looking for an experienced Senior QA Engineer to own quality for our AI voice virtual agent. This role is for someone who is equally comfortable reasoning about a large language model's behavior and reading a SIP trace.

You should be interested in testing non-deterministic systems. A voice agent takes a live phone call, transcribes speech that may be accented or noisy, interprets intent, reasons over an LLM, generates a spoken reply, and decides whether to resolve the request or hand it to a human—all within a latency budget callers will notice. Nothing in that chain can be validated with a simple assertion of equality, so you will design the evaluation approach that makes it testable anyway.

You should also be interested in the underlying telephony. Testing this agent means placing real calls: provisioning SIP endpoints and softphones, driving calls programmatically, controlling media conditions, and distinguishing a model failure from a codec, jitter, or call-routing issue.

PLEASE SUBMIT CV IN ENGLISH.
ONLY ACCEPTING CANDIDATES FROM LATAM.
ADVANCED SPOKEN ENGLISH IS REQUIRED.

Requirements

~2 min read

Multilingual testing capabilities, with emphasis on Spanish/English code-switching.

Literacy in prompt engineering, sufficient to analyze system prompts and identify potential failure modes

Remote work opportunity!

B2B Employment ($, gross).

Stable job with long-term growth perspective.

Competitive salary with annual performance review.

Really good hardware.

An exciting and challenging job with talented people around.

Continuous learning and career growth opportunities.

Compensation for professional training, seminars, and conferences.

Referral program: get rewarded for helping us grow the team with talented people.

Company-supported English classes to enhance your professional growth.

Creativity is a core requirement for this role, not a nice-to-have. The defects that matter here are found by someone who imagines the caller who interrupts mid-sentence, switches languages halfway through, gives a partial account number, answers a different question, or deliberately tries to jailbreak the agent. Scenario design is the primary skill we are hiring for.

Current State: We have automated call testing built on JsSIP/WebRTC with Python and Playwright, alongside a growing body of test scenarios. The evaluation layer—how we score responses consistently, catch regressions when a prompt or model changes, and report quality metrics leadership can act on—is where this role will have the most impact.

About us:

IDT Technologies is a part of IDT Corporation—an American telecommunications company founded in 1990 and headquartered in New Jersey. It is an industry leader in prepaid communication and payment services and one of the world's largest international voice carriers. We are listed on the NYSE, employ over 1,500 people across 20+ countries, and have revenues in excess of $1.5 billion.

Net2Phone (https://www.net2phone.com/) is a global provider of unified cloud communications solutions. It offers an integrated communications suite featuring powerful collaboration tools, including voice, messaging, chat, and unlimited domestic and international calling to 23+ countries.

PLEASE SUBMIT CV IN ENGLISH