AI Data Annotator

Job Summary

We are seeking a detail-oriented Data Annotator / Validation Engineer to support the evaluation and improvement of AI-powered chatbot systems. This role will focus on reviewing chatbot interactions, analyzing AI-generated responses, and applying established labeling guidelines to improve conversational AI performance and accuracy.

Responsibilities

• Review and evaluate chatbot conversations, responses, citations, and related artifacts.
• Apply labeling guidelines, taxonomies, and decision rules to annotate AI-generated content.
• Assess chatbot performance for accuracy, relevance, completeness, source attribution, safety, and policy compliance.
• Identify factual errors, unsupported claims, ambiguous responses, and escalation scenarios.
• Document annotation decisions with clear rationales and confidence assessments.
• Participate in calibration sessions, quality reviews, and ongoing training activities.
• Maintain accurate records of completed annotations, quality metrics, and open issues.
• Generate weekly productivity, quality, and progress reports.
• Recommend improvements to annotation guidelines and taxonomies based on recurring observations.

Required Skills

• Data Annotation (Voice & Text)
• Strong Analytical and Critical Thinking Skills
• Excellent Written and Verbal Communication
• Attention to Detail and Quality Focus
• Ability to interpret and consistently apply detailed guidelines
• Experience documenting decisions and providing concise rationales

Required Experience

• Experience labeling conversational AI or chatbot data, including text and audio.
• Strong English reading comprehension and writing skills.
• Ability to identify policy concerns, factual inaccuracies, and incomplete responses.
• Experience working with repetitive tasks while maintaining high quality.
• Ability to adapt to changing guidelines and incorporate feedback.

G-TECH Services, Inc. is a leading certified recruitment and placement firm that specializes in providing highly skilled staff in technical fields such as engineering, IT, procurement, finance and accounting. We have well-established relationships with some of the most respected companies in the country and know our clients' job requirements and corporate cultures. Once we understand your experience and career aspirations, we aim to connect you with the right opportunity.