AI Translation Evaluator; Japanese-English

Join the Appen team as an Independent Contractor for Project Centric.

Project Centric is seeking individuals for an ongoing, ad-hoc project focused on improving AI-powered translation. In this project, participants will evaluate context-dependent translations produced by an AI chatbot, where each item includes a conversation history, a translation request with additional context (such as dialect preferences, selective non-translation rules, tone/register requirements, or domain-specific terminology), and the chatbot's response. You will apply MQM error annotations, verify auto-generated rubric items for relevance, and evaluate each applicable rubric item as Pass or Fail based on whether the translation meets the user's stated requirements.

Help improve AI translation systems by evaluating Japanese-English translations for accuracy, quality, and adherence to user-specified requirements.

Key Responsibilities:
- Review conversation history and translation requests with additional contextual instructions
- Apply MQM error annotations with appropriate categories and severity levels
- Verify auto-generated rubric items for relevance, marking spurious items as needed
- Evaluate each rubric item as Pass or Fail based on the user's stated requirements
- Provide accurate and consistent ratings based on project guidelines
- Complete assigned tasks within the given timelines

Key Requirements:
- Must be a native Japanese speaker with a strong command of English, including grammar, vocabulary, and translation conventions
- Must be a language specialist, professional translator, or hold a Master's Degree in a language-related field
- Keen attention to detail
- Access to a stable internet connection and a computer

This role is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account and reset the password, complete the setup requirements, and proceed with your application for this project-based role.

If you have a passion for language and translation, this is a great opportunity to help shape AI systems that produce accurate, context-aware multilingual translations.

Slots are limited — apply through CrowdGen and start evaluating!

#crowdgen