GenAI Quality Analyst (Thai Speaking)

About the team
The GenAI & Emerging Products team in the Quality Operations function is responsible for providing policy as well as quality operations support to a growing list of Byte Dance's Emerging/AI Products. We evaluate the overall quality of each moderation team or outsourced partners through the analysis of samples extracted from the online moderation queue or applicable quality strategy to ensure platform/app safety for a safe and enjoyable environment for our users as we play a critical role in safeguarding user experiences

About the role
We are looking for a detail-oriented and analytical Quality Analyst to evaluate, test, and improve the output of our Generative AI models. You will play a crucial role in ensuring that AI-generated content is accurate, relevant, safe, coherent, and aligns with our standards. Your feedback will directly influence the model's performance and user experience.

Responsibilities:

• Review AI-generated text and other model outputs for quality, relevance, accuracy, and coherence.
• Perform analysis of errors in platform/moderation quality and feedback to the respective team
• Participate in the development of quality inspection standards and continuously optimize the process and system platform
• Responsible for policy cascading, clarification, and calibration sessions to ensure an accurate understanding of the policy and operations readiness in accordance with responsible product quality delivery
• Provide high-level and detailed reports/RCA on the Market/Site Quality Level report
• Coordinate and work closely with Process Delivery, Policy Enforcement, Content Ops to ensure safety of product (if applicable), and other relevant stakeholders to support quality operations-related tasks.
• Make consistent, evidence-based decisions in ambiguous or incomplete scenarios using defined evaluation frameworks.
• Contribute to ongoing improvement of policy guidance by highlighting edge cases, gaps, and emerging patterns.
• Identify and assess potential cultural bias in AI-generated content and model outputs, ensuring appropriate cultural sensitivity in evaluation and feedback.

Requirements:

Minimum Qualification(s):

• Proficiency in Thai and English is required to collaborate effectively with global partners and key stakeholders based in Thai-speaking markets, where Thai is a primary working language.
• Strong written and reading comprehension skills in both Thai and English, with the ability to interpret and apply structured guidelines, policies, and operational frameworks accurately.
• Ability to work effectively in a dynamic environment, managing tight deadlines while maintaining accuracy, consistency, and strong attention to detail.
• Strong analytical and critical-thinking skills, with the ability to synthesise information, assess evidence, and make sound, evidence-based decisions.
• Comfortable working with AI systems and emerging technologies, with the ability to adapt to evolving tools, workflows, and operational requirements.

Preferred Qualification(s):

• 3+ years of relevant experience in Trust & Safety, Online Safety Operations, Content Moderation, Policy Enforcement, Data Annotation, AI Training Data Operations, BPO Operations, Risk, Compliance, or Regulatory Operations.
• Experience working with annotation tools, structured data workflows, or operational quality processes.
• Experience working with AI systems, machine learning datasets, Generative AI workflows, or AI training/evaluation processes is highly desirable.
• Demonstrated ability to operate in environments requiring high accuracy, sound judgement, and consistent application of guidelines across complex or ambiguous cases.
• Bachelor’s degree or equivalent relevant professional experience preferred.