Experienced Generalist

About this role

**1\. Role Overview** Mercor is seeking generalist experts to support a large-scale project with a leading AI research partner. The goal is to create and refine a diverse dataset of human-aligned tasks for supervised fine-tuning (SFT) of frontier models. Generalists will contribute by generating realistic prompts, evaluating AI outputs, and iterating on responses to ensure quality and domain relevance. This is a short-term, project-based opportunity ideal for professionals with broad analytical capabilities and writing skills. **2\. Key Responsibilities** - Create / evaluate base prompts across a range of generalist topics - Review and revise AI-generated responses for clarity, accuracy, and alignment with human reasoning - Develop prompt-response iterations using variations in length, style, and system prompts - Contribute to benchmarking efforts by identifying failure points in model responses - Create Rubrics to evaluate the prompts - Apply consistent quality standards across diverse content types (e.g., summaries, Q&A, synthesis tasks) **3\. Ideal Qualifications** - 2+ years of experience in research, education, writing, editing, or adjacent analytical fields - Proven ability to communicate complex topics clearly and concisely - Strong attention to detail and critical thinking skills - Comfort working independently with evolving task guidelines - Familiarity with LLMs or AI-assisted writing tools is a plus **4\. More About the Opportunity** - Expected commitment: 10–25 hours/week - Flexible task structure with batch-based assignments **5\. Application Process** - Submit your resume to get started - Complete the Domain Expert interview - We aim to follow up within a few business days

Skills & domains

• ai-training
• rlhf
• sme
• annotation
• Miscellaneous