codvo-team
codvo-team~2d ago
New

(US) QA Auditor (Sampling, Quality Gates, Release Readiness)

IndiaIndia·PuneRemotemid
OtherAuditor
0 views0 saves0 applied

Quick Summary

Overview

QA Auditor (Sampling, Quality Gates, Release Readiness) - USA JD: QA Auditor — Surgical Video Annotation (Sampling, Quality Gates, Release Readiness) Location: USA | Type: Full-time Reports to: Quality Lead / Program Lead Role goal: Protect dataset quality at scale by running sampling-based…

Key Responsibilities

Execute sampling plans (stratified by label type, difficulty, site/surgeon/device, model confidence) for ongoing QA and release audits.

Requirements Summary

3–7+ years in data QA / annotation QA / operations quality; experience auditing labeled datasets (video preferred). Strong command of sampling-based QA: stratified sampling, acceptance thresholds, and audit scoring.

Technical Tools
OtherAuditor
QA Auditor (Sampling, Quality Gates, Release Readiness) - USA  
JD: QA Auditor — Surgical Video Annotation (Sampling, Quality Gates, Release Readiness) 
 
Location: USA | Type: Full-time 
Reports to: Quality Lead / Program Lead 
Role goal: Protect dataset quality at scale by running sampling-based audits, enforcing quality gates, and ensuring every dataset release is audit-ready and meets acceptance thresholds.
 

At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.



Responsibilities 
Execute sampling plans (stratified by label type, difficulty, site/surgeon/device, model confidence) for ongoing QA and release audits.
Audit annotations against guidelines + ontology; score defects using standardized rubrics (severity, type, root cause).

Run and validate quality gates prior to release: 
completeness/coverage checks
schema/constraint checks (illegal combinations, temporal consistency, boundary rules)
defect density and rework thresholds
Generate rework tickets with precise instructions; track closure and verify fixes.
Partner with Annotation Lead to drive calibration actions (training refreshers, guideline clarifications, examples library).
Maintain QA dashboards: defect rate, rework %, gate pass rate, audit cycle time, top error patterns by annotator/team/label type.
Support release readiness: ensure required artifacts are complete for the Evidence Pack (QA results, sampling logs, sign-offs).
Escalate systematic issues to Adjudication/Clinical Review (definition gaps, ambiguous classes, recurring edge cases).
Deliverables (what you produce weekly)
QA audit reports (sample size, findings, severity distribution, root-cause categories)
Gate status + release checklist sign-off recommendations
Rework queue and closure verification
Trend insights and corrective action plan (top 3 issues + fixes)


Requirements 
3–7+ years in data QA / annotation QA / operations quality; experience auditing labeled datasets (video preferred).
Strong command of sampling-based QA: stratified sampling, acceptance thresholds, and audit scoring.
High attention to detail; comfortable reading and enforcing detailed SOPs/guidelines.
Strong documentation skills; can write clear defect descriptions and rework instructions.
Comfortable with dashboards/spreadsheets; basic metric literacy (defect density, rework, throughput).

Note- Please apply via our official careers portal only, as applications sent directly to executives may not be considered. 

Location & Eligibility

Where is the job
Pune, India
Remote within one country
Who can apply
IN

Listing Details

First seen
May 6, 2026
Last seen
May 8, 2026

Posting Health

Days active
0
Repost count
0
Trust Level
46%
Scored at
May 6, 2026

Signal breakdown

freshnesssource trustcontent trustemployer trust
Newsletter

Stay ahead of the market

Get the latest job openings, salary trends, and hiring insights delivered to your inbox every week.

A
B
C
D
Join 12,000+ marketers

No spam. Unsubscribe at any time.

codvo-team(US) QA Auditor (Sampling, Quality Gates, Release Readiness)