Product Reviewer – AI Web Application Specifications
Mercor (client confidential) · Remote
- Pay
- $30–60/hr
- Commitment
- hourly
- Hours / week
- ~40
- Source
- mercor
About this role
We're looking for experienced Product Managers, Product Designers, and Technical Product professionals to help review AI-generated web application specifications before they're used in model evaluation. You'll evaluate whether product requests are realistic, internally consistent, and clearly defined, ensuring AI-generated applications can be built and tested against high-quality specifications. ### What You'll Do - Review AI-generated product specifications for web applications. - Evaluate whether product requests are realistic, complete, and unambiguous. - Verify that subsequent feature requests build correctly on the existing product state. - Ensure product requirements align with associated browser-based test scenarios. - Identify inconsistencies, missing requirements, or unclear acceptance criteria. - Provide structured written feedback using project review guidelines. ### We're Looking For - 3+ years of experience in Product Management, Technical Product Management, Product Design, or Business Analysis. - Experience writing or reviewing product requirements, PRDs, user stories, or acceptance criteria. - Strong understanding of modern web application workflows and user experiences. - Comfortable evaluating complex feature specifications and product logic. - Excellent written communication and attention to detail. - Experience working with engineering and QA teams is preferred. ### **Why Join?** - Help shape the quality of next-generation AI systems by reviewing real-world product specifications used in model evaluation. - Apply your product expertise to challenging web application scenarios spanning user experience, feature design, and product logic. - Work alongside experienced reviewers on a fast-paced, high-impact AI benchmarking initiative.
Eligible applicant countries
This role accepts applicants from:
- USA
Skills & domains
- ai-training
- rlhf
- sme
- annotation
- Business Operations
