Litigation Lawyer (Australia)

About this role

Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of **Australian law**. We are hiring experienced **litigation & disputes lawyers** to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric. ### What you'll do - Run the same set of prompts across **two AI (LLM) platforms** - Compare the outputs from both platforms side by side - Score each response against a **standardized rubric** we provide - Submit concise written feedback for every evaluation ### Requirements - **Primarily law-firm / chambers experience** — at least **2 years (3+ preferred)** at a law firm or barristers' chambers in **litigation, disputes, or contentious** practice. If you are currently in-house, that is fine only if you moved in-house **within the last 2 years** and your prior experience was at a firm/chambers. - **Qualified to practise in Australia**, with a strong command of Australian litigation and procedural law - Native or fluent **English**, with precise written communication - Able to work independently to a rubric and to deadlines ### Logistics - **Initial commitment:** ~10 hours, with strong potential for more - **Confidentiality:** all work is covered by NDA

Eligible applicant countries

This role accepts applicants from:

• AUS

Skills & domains

• ai-training
• rlhf
• sme
• annotation
• Law