Вакансии

Location: Taipei, Taipei City, Taiwan Traditional Chinese AI Product Evaluator 🎯 The Project Productive Playhouse is building a talent pool of Traditional Chinese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $11.00 USD per hour You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. ✅ What We're Looking For Native or expert-level fluency in Traditional Chinese, as spoken in Taiwan Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? 🌍 🌍 Your language skills are the whole point — and this project pays for them ⚡ Apply once, get contacted directly when a spot opens — no chasing 🏠 Work from anywhere, on your own schedule, alongside any other work you do 🤝 Clear task specs, no ongoing oversight, no micromanagement 💼 Real project experience with a global data and language services company ✨ Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: Amsterdam, North Holland, Netherlands Dutch AI Product Evaluator The Project Productive Playhouse is building a talent pool of Dutch speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $20.00 USD per hour You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. What We're Looking For Native or expert-level fluency in Dutch, as spoken in Netherlands Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? Your language skills are the whole point — and this project pays for them Apply once, get contacted directly when a spot opens — no chasing Work from anywhere, on your own schedule, alongside any other work you do Clear task specs, no ongoing oversight, no micromanagement Real project experience with a global data and language services company Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: Chiang Mai, Thailand Thai AI Product Evaluator The Project Productive Playhouse is building a talent pool of Thai speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $9.00 USD per hour 100% remote You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. What We're Looking For Native or expert-level fluency in Thai, as spoken in Thailand Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? Your language skills are the whole point — and this project pays for them Apply once, get contacted directly when a spot opens — no chasing Work from anywhere, on your own schedule, alongside any other work you do Clear task specs, no ongoing oversight, no micromanagement Real project experience with a global data and language services company Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: Berlim, Germany German AI Product Evaluator The Project Productive Playhouse is building a talent pool of German speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $20.00 USD per hour 100% remote You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. What We're Looking For Native or expert-level fluency in German , as spoken in Germany. Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? Your language skills are the whole point — and this project pays for them Apply once, get contacted directly when a spot opens — no chasing Work from anywhere, on your own schedule, alongside any other work you do Clear task specs, no ongoing oversight, no micromanagement Real project experience with a global data and language services company Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: Tokyo, Japan Japanese AI Product Evaluator The Project Productive Playhouse is building a talent pool of Japanese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered! Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $24.00 USD per hour 100% remote You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. What We're Looking For Native or expert-level fluency in Japanese , as spoken in Japan. Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? Your language skills are the whole point — and this project pays for them Apply once, get contacted directly when a spot opens — no chasing Work from anywhere, on your own schedule, alongside any other work you do Clear task specs, no ongoing oversight, no micromanagement Real project experience with a global data and language services company Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: Bandung, Jawa Barat, Indonesia Indonesian AI Product Evaluator The Project Productive Playhouse is building a talent pool of Indonesian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered! Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $10.00 USD per hour 100% remote You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. What We're Looking For Native or expert-level fluency in Indonesian , as spoken in Indonesia. Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? Your language skills are the whole point — and this project pays for them Apply once, get contacted directly when a spot opens — no chasing Work from anywhere, on your own schedule, alongside any other work you do Clear task specs, no ongoing oversight, no micromanagement Real project experience with a global data and language services company Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: Bengaluru, Karnataka, India Indian English AI Product Evaluator The Project Productive Playhouse is building a talent pool of Indian English speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered! Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $8.00 USD per hour 100% remote You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. What We're Looking For Native or expert-level fluency in English , as spoken in India. Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? Your language skills are the whole point — and this project pays for them Apply once, get contacted directly when a spot opens — no chasing Work from anywhere, on your own schedule, alongside any other work you do Clear task specs, no ongoing oversight, no micromanagement Real project experience with a global data and language services company Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: Grenoble, Auvergne-Rhône-Alpes, France French AI Product Evaluator The Project Productive Playhouse is building a talent pool of French speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered! Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $20.00 USD per hour 100% remote You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. What We're Looking For Native or expert-level fluency in French , as spoken in France. Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? Your language skills are the whole point — and this project pays for them Apply once, get contacted directly when a spot opens — no chasing Work from anywhere, on your own schedule, alongside any other work you do Clear task specs, no ongoing oversight, no micromanagement Real project experience with a global data and language services company Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: São Paulo, Brazil Brazilian Portuguese AI Product Evaluator The Project Productive Playhouse is building a talent pool of Brazilian Portuguese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered! Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $14.00 USD per hour 100% remote You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. What We're Looking For Native or expert-level fluency in Portuguese, as spoken in Brazil. Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? Your language skills are the whole point — and this project pays for them Apply once, get contacted directly when a spot opens — no chasing Work from anywhere, on your own schedule, alongside any other work you do Clear task specs, no ongoing oversight, no micromanagement Real project experience with a global data and language services company Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: New Delhi, Delhi, India Hindi AI Product Evaluator The Project Productive Playhouse is building a talent pool of Hindi speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered! Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $8.00 USD per hour 100% remote You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. What We're Looking For Native or expert-level fluency in Hindi , as spoken in India. Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? Your language skills are the whole point — and this project pays for them Apply once, get contacted directly when a spot opens — no chasing Work from anywhere, on your own schedule, alongside any other work you do Clear task specs, no ongoing oversight, no micromanagement Real project experience with a global data and language services company Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: Cairo, Egypt Egyptian Arabic AI Product Evaluator The Project Productive Playhouse is building a talent pool of Egyptian Arabic speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered! Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $10.00 USD per hour 100% remote You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. What We're Looking For Native or expert-level fluency in Arabic, as spoken in Egypt. Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? Your language skills are the whole point — and this project pays for them Apply once, get contacted directly when a spot opens — no chasing Work from anywhere, on your own schedule, alongside any other work you do Clear task specs, no ongoing oversight, no micromanagement Real project experience with a global data and language services company Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: Mexico City, CDMX, Mexico Spanish (LatAm) AI Product Evaluator The Project Productive Playhouse is building a talent pool of Spanish (LatAm) speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered! Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $14.00 USD per hour 100% remote You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. What We're Looking For Native or expert-level fluency in Spanish , as spoken in Latin America. Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? Your language skills are the whole point — and this project pays for them Apply once, get contacted directly when a spot opens — no chasing Work from anywhere, on your own schedule, alongside any other work you do Clear task specs, no ongoing oversight, no micromanagement Real project experience with a global data and language services company Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: Seoul, South Korea Korean AI Product Evaluator The Project Productive Playhouse is building a talent pool of Korean speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered! Open to freelancers based outside the U.S. This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills. The Details We’re looking for independent contractor engagement (task-based - project-based). Pay Rate: $20.00 USD per hour 100% remote You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves. This is an iterative project, work arrives in batches (there may be pauses between them). What You’ll Do As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization. Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include: Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts. Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable. Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies. What We're Looking For Native or expert-level fluency in Korean, as spoken in South Korea. Strong English reading, writing, and communication skills - assessment maybe required 18 years of age or older Hands-on experience using AI models or large language models Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups Your own smartphone, computer, reliable internet, and comfort with web-based tools Able to pass a language proficiency and technical literacy assessment Responsive communicator — quick replies move you through onboarding faster Able to start within 48 hours Why PPH? Your language skills are the whole point — and this project pays for them Apply once, get contacted directly when a spot opens — no chasing Work from anywhere, on your own schedule, alongside any other work you do Clear task specs, no ongoing oversight, no micromanagement Real project experience with a global data and language services company Work that actually improves how AI understands your language About Productive Playhouse We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive. Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry. All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Location: Muscatatuck, IN, United States Job Title Test & Evaluation (T&E) Scientist III Why IDS? IDS believes in resolving conflict, building innovative approaches to do so. Combining operational expertise with an intimate understanding of today’s greatest challenges, we bring our customers the solutions required for success in a complex and multidimensional world. IDS tailors solutions for a diverse range of government, military, nonprofit, and public-sector clients. Locations Muscatatuck, Indiana Shifts Available Please note, candidates must be flexible. Shift times are general hours; some projects may require earlier or later reporting based on customer requirements. Job Description IDS is seeking a Test & Evaluation (T&E) Scientist III to support the planning, execution, oversight, and assessment of complex Department of Defense test and evaluation activities. The selected candidate will provide technical leadership for developmental and operational test events involving cyber, electronic warfare, cyber-physical, and multi-domain capabilities. This role will support advanced training and test environments, coordinate with senior government stakeholders, and help ensure test objectives are effectively planned, executed, documented, and evaluated. The ideal candidate will bring extensive experience supporting DoD test programs and evaluating emerging technologies in operationally relevant environments. Key Duties • Plan, coordinate, and oversee developmental test and evaluation (DT&E) and operational test and evaluation (OT&E) activities. • Support cyber, electronic warfare, cyber-physical, and multi-domain test events. • Develop test objectives, methodologies, success criteria, and evaluation approaches. • Coordinate test and training events with government stakeholders and mission partners. • Support the integration and evaluation of capabilities within cyber-physical and live-virtual-constructive (LVC) environments. • Analyze test results and assess system performance against established requirements. • Prepare test reports, after-action reviews, lessons learned, and technical documentation. • Develop and deliver briefings for government customers and senior leadership. • Support test planning activities for operational and developmental assessments. • Coordinate with technical teams to support OT/IT integration and test execution. • Provide recommendations to improve testing effectiveness and mission outcomes. Requirements • Master's degree in Engineering, Computer Science, Cybersecurity, Systems Analysis, or a related technical discipline required. • PhD in a related field preferred. • DoDM 8140.03 IAT II certification or higher required. • Active TS/SCI security clearance required. • Minimum of twelve (12) years of progressive experience in DoD test and evaluation, RDT&E program management, or cyber range/cyber-physical system test operations supporting DoD programs. • Demonstrated senior-level experience planning, overseeing, and evaluating DT&E or OT&E events for cyber, electronic warfare, or multi-domain operations capabilities. • Demonstrated experience coordinating test or training events with senior DoD stakeholders, including CYBERCOM-level organizations, joint or coalition commands, or interagency partners. • Demonstrated experience with cyber-physical range architectures, live-virtual-constructive (LVC) test environments, and OT/IT system integration in a DoD training or test environment. • Demonstrated analytical and documentation experience including test reports, after-action reviews, lessons learned deliverables, and senior leader briefings. • Electronic Warfare systems experience from military service or DoD defense contractor experience preferred. • DoD program management experience and PMP certification or equivalent preferred. Compensation • Competitive Hourly Pay • Benefits

Location: Tokyo, Japan; Barcelona, Spain; Portland, OR Workplace: onsite About Welocalize  Welocalize, a Welo Global brand, serves localization teams through AI-enabled multilingual content solutions that enable enterprises to operate and scale globally. Welocalize combines AI, automation, and human expertise to support enterprises in more than 300 languages, enabling accurate, culturally aligned, and compliant multilingual content at scale.   Welocalize’s Opal Platform comprises patented technology designed to automate multilingual content and improve workflow performance for enterprises. Opal functions as an agentic system that orchestrates AI, automation, and human expertise to coordinate content workflows across the lifecycle, improving speed, scalability, and operational control for global enterprises. These solutions operate within a secure and compliant environment supported by seven ISO certifications. Welocalize is headquartered in New York with offices worldwide. welocalize.com  ROLE OVERVIEW  Welocalize is looking for a native-level Indonesian speaker to join a confidential, large-scale AI and consumer technology programme for a major global technology and communications client.  It's a hands-on, on-site role that combines two things: evaluating a pre-release AI model in your language, and testing how the product actually performs on a client-supplied device — a smartphone and a next-generation smart glass. If you enjoy noticing the detail other people miss, this is work you'll find satisfying.  Welocalize is looking for a native-level Indonesian speaker to join a large-scale AI and consumer technology programme.  It's a hands-on, on-site role that combines two things: evaluating a pre-release AI model in your language, and testing how it performs on a real device. You'll be among the first people to see this technology in Indonesian, and your judgement shapes how well it works before anyone else uses it.  If you enjoy noticing the detail other people miss, this is work you'll find satisfying.    MAIN RESPONSIBILITIES  Review pre-release AI model output in Indonesian and judge it on accuracy, naturalness, appropriateness, and overall quality — would a native speaker really say it this way? This includes fact-checking each response against the source material.

Location: Barcelona, Spain Workplace: onsite About Welocalize  Welocalize, a Welo Global brand, serves localization teams through AI-enabled multilingual content solutions that enable enterprises to operate and scale globally. Welocalize combines AI, automation, and human expertise to support enterprises in more than 300 languages, enabling accurate, culturally aligned, and compliant multilingual content at scale.   Welocalize’s Opal Platform comprises patented technology designed to automate multilingual content and improve workflow performance for enterprises. Opal functions as an agentic system that orchestrates AI, automation, and human expertise to coordinate content workflows across the lifecycle, improving speed, scalability, and operational control for global enterprises. These solutions operate within a secure and compliant environment supported by seven ISO certifications. Welocalize is headquartered in New York with offices worldwide. welocalize.com  ROLE OVERVIEW  Welocalize is looking for a native-level Portuguese Brazilian speaker to join a confidential, large-scale AI and consumer technology programme for a major global technology and communications client.  It's a hands-on, on-site role that combines two things: evaluating a pre-release AI model in your language, and testing how the product actually performs on a client-supplied device — a smartphone and a next-generation smart glass. If you enjoy noticing the detail other people miss, this is work you'll find satisfying.  Welocalize is looking for a native-level Portuguese Brazilian speaker to join a large-scale AI and consumer technology programme.  It's a hands-on, on-site role that combines two things: evaluating a pre-release AI model in your language, and testing how it performs on a real device. You'll be among the first people to see this technology in Portuguese Brazilian , and your judgement shapes how well it works before anyone else uses it.  If you enjoy noticing the detail other people miss, this is work you'll find satisfying.    MAIN RESPONSIBILITIES  Review pre-release AI model output in Portuguese Brazilian and judge it on accuracy, naturalness, appropriateness, and overall quality — would a native speaker really say it this way? This includes fact-checking each response against the source material.

Location: Saint Thomas, Virgin Islands, U.S. Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands refine their services. Whether visiting boutiques, purchasing online, or returning a product, your voice shapes the future of luxury. • Flexibility - each in-store visit takes approximately 20 minutes, giving you the flexibility to complete multiple assignments. • Frequent opportunities - perform several missions per month and collaborate with some of the most prestigious brands worldwide. What you will be doing: 1. Choose your assignments - align your missions with your personal preferences and profile. 2. Visit luxury stores or evaluate online - engage with sales associates in the stores or online from the comfort of your home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback - use our platform to share your observations through questionnaires. Perks of the Role: • Collaborate with iconic brands across industries. • Flexible assignments tailored to your interests. • Compensation for your time and input, with the potential for reimbursement on purchases. • A user-friendly platform for managing missions and feedback. How to Join the CXG Community: 1. Register: sign up at live.cxg.com and confirm your email. 2. Complete your profile: fill out your details to 100% and get verified. 3. Get certified: pass the General Certification to access missions. 4. Apply for missions: explore assignments with brands that excite you. 5. Start evaluating: begin making a difference in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations: Reimbursement for approved items as stated in the mission brief. About CXG At CXG, we connect premium brands with over 80,000 evaluators across 70 countries. With 12 global offices and almost two decades of CX retail expertise, we’re committed to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform, CXG Live. On this platform, you can seamlessly manage missions, certifications, and feedback. Requirements Must be 18 years or older (21 years or older in the United States). Current customer of premium and luxury brands. Not currently under contract with any retail brands, to ensure impartiality. Punctual, organized, detail-oriented, and reliable. Observant and passionate about customer experience. No prior experience is required; we value honest feedback from genuine customers.

Location: Singapore About Cantina: Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning. About the Role: Cantina is looking for a Member of Technical Staff to join our growing Singapore research team. In this role, you will shape the data and evaluation strategies behind our video generation models. You will own the full data lifecycle—from defining data requirements and annotation standards to building high-quality datasets, evaluating model outputs, and translating findings into actionable recommendations for model improvement. You will work closely with research scientists, machine learning engineers, product teams, and external data partners to strengthen the data–model–evaluation feedback loop. What You’ll Do - Define quality standards for video generation across aesthetics, realism, composition, motion, temporal consistency, instruction following, subject consistency, editing preservation, and text rendering. - Evaluate model iterations, analyze failure patterns, and translate findings into actionable data, training, and prompting strategies. - Own end-to-end training data projects, including sourcing, construction, annotation, captioning, quality control, and delivery. - Develop labeling systems that support dataset segmentation, coverage analysis, quality filtering, training-data mixtures, and model performance attribution. - Design annotation and captioning standards for video generation, editing, and multi-reference tasks. - Create and evaluate synthetic-data workflows based on their stability, usability, quality, and training value. - Develop automated annotation and filtering workflows using vision-language models, system prompts, and quality-scoring models. - Build structured model evaluation processes covering test-set design, evaluation criteria, failure attribution, and reporting. - Establish feedback loops connecting model evaluation and negative-case analysis with data strategy and model iteration. - Train and calibrate annotation teams and external data partners, conduct quality audits, and improve delivery standards. - Partner with research, engineering, product, and creative teams to execute data initiatives and identify future model capabilities. What You’ll Bring - Hands-on experience in data strategy, dataset development, annotation, or model evaluation for generative image, video, or multimodal models. - Experience supporting model development across continued training, supervised fine-tuning, post-training, or evaluation. - Strong understanding of generative media tasks, including image and video generation, multimodal generation, and instruction-based editing. - Experience developing labeling taxonomies, annotation guidelines, captioning standards, quality thresholds, and evaluation frameworks. - Strong visual judgment and the ability to translate subjective quality expectations into measurable data and evaluation standards. - Experience managing large-scale data-production or annotation projects and collaborating with research, engineering, creative, and external partner teams. - Familiarity with automated captioning, synthetic-data generation, vision-language models, prompt design, Python, SQL, or other data and workflow automation tools is a plus. Benefits We Offer: - Competitive salary and generous company equity - Personal time off and paid holidays - Health insurance - Global travel insurance: Covers you when traveling internationally - Monthly spending stipend: $500 (~S$635) - Equipment: All equipment needed for your home office