Job Description
Responsibilities
- Model Evaluation: Review and score AI-generated customer interactions across Foundational, Experiential, and Operational dimensions (e.g., Action Fidelity, Faithfulness, Halucination, Compliance, Tone, and Handoff).
- Intent & Fact Verification: Benchmark both informational (R1) and transactional (R2) customer queries against authoritative business sources (FAQs, product catalogs, SOPs) within the task UI.
- Quality Assurance: Participate in dual-review processes and daily calibration audits to ensure inter-rater agreement and establish ground-truth performance targets.
- Performance Targets: Deliver precise evaluations within a fast-p
aced daily turnaround cycle (~45-minute average handle time per job).
Required Qualifications & Skills
- Customer Service Background: Prior experience in customer service, cal centers, retail, or handling customer communications via email, chat, or phone (highly prioritized).
- English Proficiency: Exceptional written English skils with a strong command of tone, brand voice, grammar, and nuance.
- Analytical Precision: Ability to strictly fo low multi-tier evaluation guidelines, complex logic trees, and technical rubrics without deviation. Tech Adaptability: Comfort using dedicated web-based tools and labeling interfaces.
Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#GraphicDesignJobsOnline
#WebDesignRemoteJobs
#FreelanceGraphicDesigner
#WorkFromHomeDesignJobs
#OnlineWebDesignWork
#RemoteDesignOpportunities
#HireGraphicDesigners
#DigitalDesignCareers
# Dynamicbrand guru