Legal Expert — Disputes & International, UK (Project Donna)

About this role

Mercor is partnering with a leading legal AI company on a blinded human-preference study. We are hiring **UK-based disputes and international arbitration** lawyers to serve as expert reviewers — reading a realistic legal matter, reviewing six AI-generated work products for it, and recording which they prefer with written reasoning. ### What you'll do - Read a synthetic legal matter and its underlying documents - Review **six blinded AI deliverables** (labelled A–F) for that matter - Make **five head-to-head comparisons** against a common comparator output - Write a short, specific rationale for every preference ### Practice scope International arbitration and award enforcement, sanctions and export controls, cross-border disputes and emergency interim relief. ### Requirements - Qualified lawyer with substantive practice experience in the areas above - Able to judge work product holistically — correctness, completeness, judgment, usefulness - Precise written English - Able to work independently to written instructions and a deadline ### Logistics - **Commitment:** ~24 hours across the engagement - **Confidentiality:** all work is covered by NDA. External AI tools must not be used on any project material.

Skills & domains

• ai-training
• rlhf
• sme
• annotation