Head of Insights – Executive Report Evaluation Expert
Mercor (client confidential) · Remote
- Pay
- $200/hr
- Commitment
- hourly
- Hours / week
- ~40
- Source
- mercor
About this role
Mercor is partnering with a leading AI research company to improve how AI systems generate executive-level business reports and strategic recommendations. We're looking for experienced insights leaders to help define what excellent executive reporting looks like, create and review high-quality reports that address complex business questions, and evaluate AI-generated reasoning and outputs. This is a chance to apply your enterprise insights leadership experience to developing next-generation AI systems that support business decision-making. ## Responsibilities ### Report Framework Development - Define standards for high-quality executive reports and strategic recommendations - Establish best practices for insight communication, executive storytelling, recommendation development, and decision support - Help create evaluation rubrics that distinguish exceptional, average, and poor-quality outputs ### Report Writing & Review - Analyse business questions generated by AI systems - Assess whether reports effectively answer business questions and support executive decision-making - Produce and review decision-ready reports comparable to deliverables presented to C-suite and senior leadership teams ### Session Scoring & Evaluation Review AI-generated research and reporting workflows across: - Consistency of reasoning and recommendations - Accuracy of analyses and conclusions - Appropriateness of confidence assessments - Quality of logical reasoning - Executive readiness of final outputs Provide detailed feedback and scoring rationale. ## Requirements ### Must Have - 10+ years of experience in consumer insights, market intelligence, strategy, research, or business insights leadership - Current or former Director, Senior Director, VP, Head of Insights, Head of Consumer Insights, Head of Market Intelligence, or equivalent leadership role - Experience leading insights functions within a Fortune 100 company or similarly large enterprise - Extensive experience presenting research findings and recommendations to executive leadership teams - Proven track record influencing strategic business decisions through research and analysis ## Engagement Details - Engagement Length: 1 month initially, with potential extension - Commitment: 40 hours during the first week (training, calibration, and framework development), followed by approximately 15 hours per week for the remainder of the engagement ## Why Join - Help shape how future AI systems support executive decision-making - Apply insights and leadership expertise to cutting-edge AI evaluation work - Work alongside senior consultants, researchers, and industry leaders
Eligible applicant countries
This role accepts applicants from:
- USA
Skills & domains
- ai-training
- rlhf
- sme
- annotation
- Business Operations
