Skip to content

Mercor

Open 31d

AI Developer Trace Task Auditor

Posted Updated

Description

Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab’s models. You’ll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback.

Basic Qualifications
• 3+ years professional software development
• Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar)
• Strong code-reading and debugging skills across full-stack or backend systems
• Ability to evaluate multi-step coding trajectories for correctness and best practice

Preferred Qualifications
• Experience with Kiro or Amazon CodeCatalyst
• Prior work evaluating or grading AI-generated code
• Contributions to developer tooling

Skills

Apply

Apply to AI Developer Trace Task Auditor at Mercor

Create a free account first, or go straight to the employer.

Free RoleWatch account

  • Get an email when new jobs match your search
  • Save jobs and track every application
  • See how well your CV matches each job

Already have one?

No account needed. Opens the employer's own site in a new tab.

See also

AI Engineering jobs by country — openings, pay and top skills →