Location: Pune, Maharashtra, India
Marathi AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Marathi speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $8.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Marathi, as spoken in India
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Pune, Maharashtra, India; We welcome applicants of all backgrounds and abilities, regardless of location or engagement type
Location: Tirana, Tirana County, Albania
Albanian AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Albanian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $12.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Albanian, as spoken in Albania
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Surat, Gujarat, India
Gujarati AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Gujarati speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $8.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Gujarati, as spoken in India
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Bengaluru, Karnataka, India
Kannada AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Kannada speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $8.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Kannada, as spoken in India
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Velencia, Valencia, Spain
Spanish (Spain) AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Spanish (Spain)
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $15.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Spanish
, as spoken in Spain
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Warsaw, Masovian Voivodeship, Poland
Polish AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Polish speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $14.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Polish, as spoken in Poland
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Yerevan, Armenia
Armenian AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Armenian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $15.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Armenian, as spoken in Armenia
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Taipei, Taipei City, Taiwan
Traditional Chinese AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Traditional Chinese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $11.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Traditional Chinese, as spoken in Taiwan
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Amsterdam, North Holland, Netherlands
Dutch AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Dutch speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Dutch, as spoken in Netherlands
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Chiang Mai, Thailand
Thai AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Thai speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $9.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Thai, as spoken in Thailand
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Budapest, Hungary
Location:
Hungary (Remote)
Status:
Full-Time | Permanent | Exempt Status
Pay:
USD $50,000 - $60,000
Requirement:
Bachelor's degree or equivalent practical experience
Looking for an impactful and exciting role with a strong focus on product design? Join Productive Playhouse as a Product Manager and help shape the experience across Central and pZero, our company internal linked contributing platform. In this flexible, remote role, you’ll turn user insights and stakeholder needs into thoughtful product solutions while partnering closely with engineering and cross-functional teams. No production frontend coding is required.
Key Responsibilities
Own the daily product loop for Central and pZero, from user evidence and problem definition through requirements, delivery, rollout, and adoption.
Translate user evidence and stakeholder input into clear product briefs and PRDs, including problem, scope, exclusions, success measures, and acceptance criteria.
Lead product design for core Central and pZero workflows, including journey mapping, information architecture, prototyping in Figma or an equivalent tool, and usability testing.
Partner with the external engineering team throughout delivery, clarifying requirements and keeping work moving through review and release.
Bring Product Quality into the work early enough to shape journeys, testability, and release evidence.
Own rollout and adoption for shipped features, ensuring intended users can find, understand, and use new functionality.
Track product outcomes after release, including adoption, task completion, cycle time, rework, defects, support burden, and the amount of follow-up required from the Director of Product.
Own manager-facing and worker-facing product documentation, including onboarding materials, tutorials, how-to guides, and release education.
Maintain a practical, shared design foundation with Iron Forge covering navigation, forms, tables, statuses, errors, permissions, accessibility, and responsive behavior.
Maintain shared product knowledge in company-approved project and knowledge management systems, including roadmap, decisions, user evidence, product behavior, and release learning.
Use approved AI tools and shared skills to improve the speed and quality of research, writing, analysis, prototyping, and documentation.
Collect and prioritize input from Operations, Product Quality, Engineering, support signals, and client programs.
Bring well-supported recommendations, backed by evidence and tradeoffs, to the Director of Product on major product decisions, while owning routine and reversible decisions independently.
Perform other duties and ad-hoc projects as assigned.
Qualifications & Skills
If selected to move forward in the recruitment process, candidates will be required to complete a pre-assessment. Completion of the required assessment is a prerequisite for advancement to the next stage of the selection process.
Bachelor's degree in a relevant field, or equivalent practical experience in product management or a closely related discipline.
Demonstrated experience as a product owner or product manager, ideally within AI workforce product; scope of ownership matters more than years of tenure.
Hands-on product or UX design experience, ideally including journey mapping, prototyping, and usability testing.
Proven ability to turn incomplete or conflicting stakeholder input into a clear, bounded product problem.
Experience working closely with engineering teams as a partner, not solely through ticket handoffs.
Comfort using data to make or evaluate decisions, including recognizing when available data is insufficient.
Experience owning outcomes after release, including adoption, documentation, and iteration based on real usage.
Working familiarity with AI tools for research, writing, prototyping, and documentation, with clear human review and accountability.
Strong written communication skills, able to produce material that developers, operators, managers, and users can act on directly.
Ability to work effectively across distributed teams and manage ambiguity without creating unnecessary noise.
Comfortable inspecting product behavior, reading technical material, and working with data; production coding is not required.
Cross-functional collaboration and conflict resolution skills, with the decisiveness expected of a single-threaded owner.
Work Environment & Physical Requirements
Occasional travel may be required for special meetings, training, or team gatherings at the company’s headquarters or other designated locations.
Routine use of standard office equipment such as computers, phones, filing cabinets, etc.
Strong visual acuity for reviewing detailed documents and data on computer screens.
Manual dexterity for operating a computer, including using a keyboard and mouse.
Ability to lift and carry office supplies or equipment weighing up to 25 pounds.
Clear verbal and written communication skills for collaboration across teams.
Capacity to manage tasks that require prolonged periods of focus and concentration.
Ability to handle the physical demands of a standard workweek, which may include occasional overtime, nights, weekends, and holidays, if needed.
About Us
As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children's language acquisition, our commitment to excellence, forward-thinking strategies, and world-wide cultural experience has proven key for delivering exceptional service.
Originally founded as an educational production company, Productive Playhouse made a mark with our award winning children’s series, which taught fundamental subjects through engaging and effective programming. This early success paved the way for our evolution into a comprehensive data services provider.
Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services. Our current offerings include transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity. Our commitment to innovation means we continually enhance our service portfolio to meet the evolving needs of our clients.
At Productive Playhouse, we are proud of our reputation for addressing complex challenges with agility and delivering premium, secure data solutions across diverse environments. Our dynamic team is dedicated to maintaining the highest standards and ensuring exceptional service every time.
Disclaimer
This job description is intended to describe the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties, responsibilities, or qualifications. Duties, responsibilities, and scope may change or evolve based on business needs and organizational priorities. Productive Playhouse reserves the right to modify, revise, or reassign responsibilities as necessary, consistent with applicable law.
Equal Employment Opportunity
Productive Playhouse is an equal opportunity employer. We are committed to fostering a diverse, equitable, and inclusive work environment and do not discriminate on the basis of race, color, religion, sex, gender identity or expression, sexual orientation, age, national origin, ancestry, disability, medical condition, genetic information, marital status, military or veteran status, or any other status protected by applicable law.
Employment Relationship
Employment with Productive Playhouse is at-will where permitted by law, meaning that either the employee or the company may terminate the employment relationship at any time, with or without cause or notice. Where local laws require different terms or conditions, the employment relationship will be governed in accordance with applicable legal requirements.
Work Authorization & Verification
All offers of employment are contingent upon the candidate’s ability to provide valid documentation verifying identity and authorization to work in the United States or the applicable hiring location. Productive Playhouse participates in E-Verify where required by law.
Reasonable Accommodation
Productive Playhouse provides reasonable accommodations for qualified individuals with disabilities, in accordance with applicable law. Candidates or employees who require assistance or accommodation to perform the essential functions of the role may contact the Human Resources Department.
Location: Berlim, Germany
German AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of German
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in German
, as spoken in Germany.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Tokyo, Japan
Japanese AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Japanese
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $24.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Japanese
, as spoken in Japan.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Bandung, Jawa Barat, Indonesia
Indonesian AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Indonesian
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $10.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Indonesian
, as spoken in Indonesia.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Bengaluru, Karnataka, India
Indian English AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Indian English
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $8.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in English
, as spoken in India.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Grenoble, Auvergne-Rhône-Alpes, France
French AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
French
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in French
, as spoken in France.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: São Paulo, Brazil
Brazilian Portuguese AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Brazilian Portuguese
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $14.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Portuguese, as spoken in Brazil.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: New Delhi, Delhi, India
Hindi AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Hindi
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $8.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Hindi
, as spoken in India.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
We welcome applicants of all backgrounds and abilities, regardless of location or engagement type
Surat, Gujarat, India; We welcome applicants of all backgrounds and abilities, regardless of location or engagement type
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.