Internet-Native Bilingual Evaluator Expert (French)

About this role

Mercor is seeking Internet-Native Bilingual Evaluator Experts (French–English) to contribute to cutting-edge AI research focused on multilingual communication, internet culture, and real-world language use. This role is ideal for individuals who actively participate in both French- and English-language online communities and understand how internet culture, slang, humour, and social norms differ across languages. ## Job Responsibilities ### Evaluate Internet-Native Communication - Analyse content from French- and English-speaking online communities. - Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity. - Identify errors involving slang, memes, cultural references, sarcasm, and code-switching. ### Develop Evaluation Standards - Build evaluation rubrics for bilingual internet communication. - Define expectations for culturally appropriate and platform-native language. - Document linguistic and cultural edge cases. ### Conduct Model Testing and Feedback - Test language models using real-world bilingual prompts. - Evaluate outputs in English and French. - Provide detailed feedback to improve performance. ### Support Quality Assurance - Participate in QA reviews and benchmark creation. - Ensure consistency across evaluators and datasets. ## Minimum Qualifications - Native or near-native fluency in French and professional fluency in English. - Strong familiarity with online communities across France, Québec, Belgium, Switzerland, or other French-speaking regions. - Active participation in internet culture across both languages. - Strong writing, analytical, and critical thinking skills. - Available to commit 10–20 hours per week. ## Preferred Qualifications - Background in linguistics, translation, localisation, social media, journalism, humanities, or AI evaluation. - Familiarity with differences between European French, Québec French, and other French varieties. - Experience evaluating online content and internet-native communication. - Interest in AI and multilingual language technologies.

Skills & domains

• ai-training
• rlhf
• sme
• annotation
• Data Analysis