Japanese AI Evaluation Specialist (Japan)

About this role

Opportunity Overview Handshake is looking for Japanese speakers based in Japan to help make AI responses more personalized. This is not a traditional job — you'll share your own real-world experience using ChatGPT and help evaluate and rank AI responses so future models can better tailor their answers to individual users. This is an ongoing, project-based opportunity you can take on alongside your current role. What You'll Do Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning Provide clear written feedback that helps AI better understand and personalize responses for individual users Complete tasks at your own pace with no set schedule or minimum hour requirement Qualifications Ideal candidates meet all of the following: Location — Based in Japan and able to work remotely in an asynchronous, self-directed capacity Language — Fluent in Japanese, both written and spoken, with strong written communication skills for explaining your reasoning clearly AI experience — Prior hands-on experience using ChatGPT or similar AI chat assistants, with enough familiarity to compare responses thoughtfully and articulate what makes one answer better suited to a given user than another Judgment — Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle Required for all applicants Comfortable sharing your own ChatGPT conversation history for research and product improvement purposes (handled confidentially) Strong written communication in Japanese Ability to work independently in a remote, asynchronous environment

Skills & domains

• ai-training
• expert
• phd