AI Annotation / Intent Verification Specialist (Entry-Level) - 16955

Location: Remote, based in the Philippines
Work Hours: U.S. PST business hours 
Employment Type: Full-time

We are looking for an AI Annotation Specialist to support the evaluation and improvement of a conversational AI system used to automate hotel front desk calls. This role focuses on listening to real guest calls, validating AI intent classification and responses, and helping establish high quality ground truth data that feeds model accuracy, product decisions, and future capability expansion.

You will work closely with a product and AI team to ensure annotations are consistent, reliable, and actionable.

• →Listen to and annotate recorded hotel phone calls using internal annotation tools
• →Validate first level and second level intents predicted by the AI system
• →Verify the correctness and relevance of AI responses against hotel knowledge bases and documented policies
• →Flag incorrect answers, missing information, or failure patterns
• →Identify and propose new intents or sub-intents based on real guest conversations
• →Follow detailed annotation Standard Operating Procedures to ensure consistency
• →Log results and insights in shared spreadsheets or internal dashboards
• →Provide weekly summaries highlighting accuracy, volume, and recurring error patterns

• Approximately 500 calls per week
• Average annotation time of around 10 minutes per call

• Strong English listening comprehension and attention to detail
• Prior experience in data labeling, annotation, quality assurance, or content review
• Comfort working with transcripts, audio recordings, and structured guidelines
• Proficiency with Google Sheets or similar spreadsheet tools
• Ability to follow detailed processes and apply consistent judgment across large volumes of work
• Reliable internet connection and ability to work full time hours

• Familiarity with hospitality, customer service, or call center environments
• Experience annotating conversational AI, speech data, or customer support interactions
• Basic understanding of AI or machine learning workflows

• Internal call playback and transcript tools
• Google Sheets and internal dashboards
• Slack for day to day communication and weekly syncs
• Secure access to systems handling sensitive call data

Your work directly impacts how well the AI understands guests, answers questions, and improves over time. High quality annotation is foundational to making the system more accurate, reliable, and useful for hotels around the world.