Korean AI Evaluation Specialist (South Korea)

About this role

**Opportunity Overview** Handshake is looking for Korean speakers based in South Korea to help make AI responses more personalized. This is not a traditional job — you'll share your own real-world experience using ChatGPT and help evaluate and rank AI responses so future models can better tailor their answers to individual users. This is an ongoing, project-based opportunity you can take on alongside your current role. **What You'll Do** - Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools - Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning - Provide clear written feedback that helps AI better understand and personalize responses for individual users - Complete tasks at your own pace with no set schedule or minimum hour requirement **Qualifications** Ideal candidates meet all of the following: - **Location** — Based in South Korea and able to work remotely in an asynchronous, self-directed capacity - **Language** — Fluent in Korean, both written and spoken, with strong written communication skills for explaining your reasoning clearly - **AI experience** — Prior hands-on experience using ChatGPT or similar AI chat assistants, with enough familiarity to compare responses thoughtfully and articulate what makes one answer better suited to a given user than another - **Judgment** — Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle **Required for all applicants** - Comfortable sharing your own ChatGPT conversation history for research and product improvement purposes (handled confidentially) - Strong written communication in Korean - Ability to work independently in a remote, asynchronous environment

Skills & domains

• ai-training
• expert
• phd