Technical AI Evaluation Specialist

Specialist
Remote
September 16, 2026
Full Time
Application ends: December 15, 2026
Apply Now

Job Description

RESPONSIBILITIES

  • Model-Generated Code Evaluation: Evaluate AI-generated code for syntactical validity, execution accuracy, algorithmic complexity,

and architectural best practices across diverse languages.

  • Image-to-Code & UI Verification: Assess model capability in rendering pixel-perfect, responsive front-end components from

wireframes, mockups, and UI design screenshots.

  • Text-to-Code & Pairwise Analysis: Perform rigorous side-by-side (SxS) evaluations to determine model preference, scoring

completions against granular multi-dimensional rubrics.

  • Failure Mode & Edge Case Reasoning: Stress-test model completions against corner cases, boundary conditions, race conditions,

memory leaks, and input sanitization vulnerabilities.

  • Evidence-Based Rationales: Write authoritative, structured C1-level technical rationales explaining exact point deductions, execution

trace errors, and counterfactual fixes.

  • Guideline Calibration & Feedback: Collaborate with research engineers and prompt authors to refine evaluation rubrics, establish

baseline test harnesses, and identify emerging model degradation patterns.

Mandatory Requirements:

  • Experience: 2+ years of professional software development

experience OR a strong Computer Science / Software Engineering

degree with demonstrable coding proficiency.

  • Front-End / UI Exposure: Hands-on experience translating

design mockups to responsive front-end code (HTML5, modern

CSS, React, or TypeScript frameworks).

  • Code Review & RLHF Exposure: Proven background in

structured code reviews, automated testing, or prior experience in

AI model evaluation/RLHF pipelines.

  • Language & Communication: C1-equivalent professional English

proficiency with exceptional technical articulation and defensive

writing discipline.

Preferred Qualifications:

  • Multi-Language Fluency: Strong capability in Python,

JavaScript/TypeScript, Java, C++, or Go, with an aptitude for

rapidly reading and debugging unfamiliar frameworks.

  • DevOps & Tooling: Familiarity with Git, Docker, CI/CD pipelines,

AST parsers, or static code analysis tools.

  • Advanced CS Foundations: Deep understanding of data

structures, algorithms, concurrency, and secure coding practices

Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#GraphicDesignJobsOnline
#WebDesignRemoteJobs
#FreelanceGraphicDesigner
#WorkFromHomeDesignJobs
#OnlineWebDesignWork
#RemoteDesignOpportunities
#HireGraphicDesigners
#DigitalDesignCareers
# Dynamicbrand guru

Related Jobs