In-House Counsel (Japan)

About this role

Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of **Japanese law**. We are hiring experienced **in-house counsel** to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric. ### What you'll do - Run the same set of prompts across **two AI (LLM) platforms** - Compare the outputs from both platforms side by side - Score each response against a **standardized rubric** we provide - Submit concise written feedback for every evaluation ### Requirements - **5+ years** as in-house legal counsel practising in **Japan** - Strong command of Japanese law, especially **commercial and contract** matters - Sharp attention to detail and precise written communication - Able to work independently to a rubric and to deadlines ### Logistics - **Initial commitment:** ~10 hours, with strong potential for more - **Confidentiality:** all work is covered by NDA

Eligible applicant countries

This role accepts applicants from:

• JPN

Skills & domains

• ai-training
• rlhf
• sme
• annotation
• Law