Conversational AI Data Annotator

MARTIN Technologies | Dearborn, MI 
Openings: 3 
Schedule: Morning | 9:00 a.m.–5:00 p.m. 
Overtime availability required as needed 

Better AI Starts with Careful Human Judgment. 

MARTIN Technologies is seeking detail-oriented Conversational AI Data Annotators to help improve chatbot accuracy, reliability, and response quality. You will review text and audio conversations, apply approved evaluation guidelines, and provide clear feedback that helps technical teams understand where responses succeed and where improvements are needed. 

This opportunity is ideal for someone who combines analytical thinking, strong English communication, and consistent judgment with the discipline to perform accurate, repeatable reviews. 

The MARTIN Legacy 

For 30+ years, MARTIN has delivered automotive engineering and manufacturing expertise, supporting innovation across automotive, motorsports, aerospace, defense, and marine industries. Join a team that brings precision, quality, and practical problem-solving to evolving technologies. 

What You Will Do 

• Review chatbot conversations, individual responses, retrieved content, citations, and related metadata using customer-approved tools. 

• Annotate conversational AI data, including text and audio, using approved labeling guidelines, taxonomies, and decision rules. 

• Complete required labels, concise rationales, confidence assessments, and ambiguity indicators. 

• Evaluate intent recognition, task completion, correctness, completeness, relevance, and overall response quality. 

• Check whether responses are supported by available evidence and whether sources are attributed correctly. 

• Identify factual errors, unsupported claims, incomplete answers, safety concerns, and policy issues. 

• Assign approved failure categories and identify when escalation or specialist review is needed. 

• Escalate ambiguous or sensitive cases and situations not covered by existing guidance. Do not create independent standards. 

• Participate in onboarding, calibration sessions, refresher training, quality reviews, and adjudication discussions. 

• Perform first-level quality checks and correct errors identified during review. 

• Maintain accurate annotation records, quality results, exceptions, escalations, and open issues. 

• Prepare weekly reports covering completed volume, productivity, quality, backlog, risks, guideline gaps, and required actions. 

• Recommend improvements to labeling guidance based on recurring issues. Implement changes only after customer approval. 

What You Bring 

• Experience labeling conversational AI data, including text and audio. 

• Professional fluency in English, with strong reading comprehension and written communication. 

• Ability to interpret and consistently apply detailed guidelines and decision rules. 

• Strong analytical judgment and attention to detail. 

• Ability to explain labeling decisions through clear, concise written rationales. 

• Consistent accuracy when performing repetitive tasks while meeting quality and turnaround expectations. 

• Ability to incorporate feedback and adjust decisions as approved guidelines evolve. 

• Experience preparing clear progress and quality reports. 

• Bachelor’s degree. 

Preferred Experience 

• Automotive industry knowledge. 

• Experience supporting large-scale conversational AI, technology, or data-annotation programs. 

• Master’s degree. 

Core Skills 

Text and audio annotation • Chatbot evaluation • Guideline interpretation • Evidence and citation review • Written rationales • Quality checks • Issue escalation • Weekly reporting 

Work Authorization and Screening 

Applicants must currently reside in the United States and be authorized to work in the United States. Visa sponsorship is unavailable now or in the future. Applications from individuals residing outside the United States will not be considered. 

Successful completion of required security and background verification is a condition of assignment. 

Equal Employment Opportunity 

MARTIN Technologies is an Equal Opportunity Employer. Qualified applicants will receive consideration without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, disability, protected veteran status, or any other status protected by applicable law.