Location: Addis Ababa, Ethiopia
SMS Data Collection Participant - English (Ethiopia)
Rate:
$2.00 USD per qualified message
Location:
Remote: Participants must be based in
Ethiopia
Schedule:
Flexible
Project type:
Short-term/project-based
Device requirement(s):
You must use your own mobile phone and
Ethiopia phone number
The Project
Productive Playhouse is seeking English-speaking participants for a mobile messaging data collection project. Participants will submit authentic scam and spam SMS messages received on their personal mobile phones to help improve technology designed to identify fraudulent and unwanted communications.
This is a flexible, remote opportunity. Participants may submit eligible messages whenever they receive them, provided all submissions meet project requirements..
Your contributions will support the development of tools designed to make mobile messaging safer for users around the world.
Why Participate?
Earn $2.00 USD for each qualified message you submit
Participate remotely on a flexible schedule
Help improve scam-detection technology by showing how real messages appear in
English
.
Duties
Submit authentic SMS messages that meet project guidelines
Identify each message as either Scam or Spam
Categorize submissions according to the appropriate message type
Ensure all submissions are complete, accurate, and meet quality standards
Follow all project instructions and submission requirements
Please note:
Messages collected from email or other platforms are not eligible. Submissions must be SMS messages received directly on your mobile phone.
Only submissions that meet requirements will be eligible for payment
Project Requirements
You may be a good fit if you:
Are a native or expert-level fluency in
English
, as spoken in
Ethiopia
Currently located in
Ethiopia
Have access to your own mobile device
You must have access to your own
Ethiopia
phone number
Can follow project guidelines and quality standards
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Addis Ababa, Ethiopia; Remote: Participants must be based in; We welcome applicants of all backgrounds and abilities, regardless of location or engagement type
Location: London, Greater London, United Kingdom
British English AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of British English speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $18.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in English, as spoken in the United Kingdom
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Istanbul, Turkey
Turkish AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Turkish speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $12.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Turkish, as spoken in Turkey
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Coimbatore, Tamil Nadu, India
Tamil AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Tamil speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $8.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Tamil, as spoken in India
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Milan, Lombardy, Italy
Italian AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Italian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $18.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Italian, as spoken in Italy
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Lisbon, Lisbon District, Portugal
Portugal Portuguese AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Portugal Portuguese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $14.00 USD per hour
Remote position
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Portuguese, as spoken in Portugal
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Hanoi, Viet Nam
Vietnamese AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Vietnamese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $9.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Vietnamese, as spoken in Vietnam
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Melbourne, Victoria, Australia
Australian English AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Australian English speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $18.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Australian English, as spoken in Australia
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency assessment and AI evaluation task
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Petaling Jaya, Kuala Lumpur, Malaysia
Simplified Chinese AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Simplified Chinese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $11.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Simplified Chinese, as spoken in Mainland China
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Uppsala, Uppland, Sweden
Swedish AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Swedish speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Swedish, as spoken in Sweden
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Tirana, Tirana County, Albania
Albanian AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Albanian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $12.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Albanian, as spoken in Albania
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Granada, Spain
Spanish (Spain) AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Spanish (Spain)
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $15.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Spanish
, as spoken in Spain
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Warsaw, Masovian Voivodeship, Poland
Polish AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Polish speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $14.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Polish, as spoken in Poland
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Yerevan, Armenia
Armenian AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Armenian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $15.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Armenian, as spoken in Armenia
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Taipei, Taipei City, Taiwan
Traditional Chinese AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Traditional Chinese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $11.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Traditional Chinese, as spoken in Taiwan
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Groningen, Netherlands
Dutch AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Dutch speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Dutch, as spoken in Netherlands
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Budapest, Hungary
Location:
Hungary (Remote)
Status:
Full-Time | Permanent | Exempt Status
Pay:
USD $50,000 - $60,000
Requirement:
Bachelor's degree or equivalent practical experience
Looking for an impactful and exciting role with a strong focus on product design? Join Productive Playhouse as a Product Manager and help shape the experience across Central and pZero, our company internal linked contributing platform. In this flexible, remote role, you’ll turn user insights and stakeholder needs into thoughtful product solutions while partnering closely with engineering and cross-functional teams. No production frontend coding is required.
Key Responsibilities
Own the daily product loop for Central and pZero, from user evidence and problem definition through requirements, delivery, rollout, and adoption.
Translate user evidence and stakeholder input into clear product briefs and PRDs, including problem, scope, exclusions, success measures, and acceptance criteria.
Lead product design for core Central and pZero workflows, including journey mapping, information architecture, prototyping in Figma or an equivalent tool, and usability testing.
Partner with the external engineering team throughout delivery, clarifying requirements and keeping work moving through review and release.
Bring Product Quality into the work early enough to shape journeys, testability, and release evidence.
Own rollout and adoption for shipped features, ensuring intended users can find, understand, and use new functionality.
Track product outcomes after release, including adoption, task completion, cycle time, rework, defects, support burden, and the amount of follow-up required from the Director of Product.
Own manager-facing and worker-facing product documentation, including onboarding materials, tutorials, how-to guides, and release education.
Maintain a practical, shared design foundation with Iron Forge covering navigation, forms, tables, statuses, errors, permissions, accessibility, and responsive behavior.
Maintain shared product knowledge in company-approved project and knowledge management systems, including roadmap, decisions, user evidence, product behavior, and release learning.
Use approved AI tools and shared skills to improve the speed and quality of research, writing, analysis, prototyping, and documentation.
Collect and prioritize input from Operations, Product Quality, Engineering, support signals, and client programs.
Bring well-supported recommendations, backed by evidence and tradeoffs, to the Director of Product on major product decisions, while owning routine and reversible decisions independently.
Perform other duties and ad-hoc projects as assigned.
Qualifications & Skills
If selected to move forward in the recruitment process, candidates will be required to complete a pre-assessment. Completion of the required assessment is a prerequisite for advancement to the next stage of the selection process.
Bachelor's degree in a relevant field, or equivalent practical experience in product management or a closely related discipline.
Demonstrated experience as a product owner or product manager, ideally within AI workforce product; scope of ownership matters more than years of tenure.
Hands-on product or UX design experience, ideally including journey mapping, prototyping, and usability testing.
Proven ability to turn incomplete or conflicting stakeholder input into a clear, bounded product problem.
Experience working closely with engineering teams as a partner, not solely through ticket handoffs.
Comfort using data to make or evaluate decisions, including recognizing when available data is insufficient.
Experience owning outcomes after release, including adoption, documentation, and iteration based on real usage.
Working familiarity with AI tools for research, writing, prototyping, and documentation, with clear human review and accountability.
Strong written communication skills, able to produce material that developers, operators, managers, and users can act on directly.
Ability to work effectively across distributed teams and manage ambiguity without creating unnecessary noise.
Comfortable inspecting product behavior, reading technical material, and working with data; production coding is not required.
Cross-functional collaboration and conflict resolution skills, with the decisiveness expected of a single-threaded owner.
Work Environment & Physical Requirements
Occasional travel may be required for special meetings, training, or team gatherings at the company’s headquarters or other designated locations.
Routine use of standard office equipment such as computers, phones, filing cabinets, etc.
Strong visual acuity for reviewing detailed documents and data on computer screens.
Manual dexterity for operating a computer, including using a keyboard and mouse.
Ability to lift and carry office supplies or equipment weighing up to 25 pounds.
Clear verbal and written communication skills for collaboration across teams.
Capacity to manage tasks that require prolonged periods of focus and concentration.
Ability to handle the physical demands of a standard workweek, which may include occasional overtime, nights, weekends, and holidays, if needed.
About Us
As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children's language acquisition, our commitment to excellence, forward-thinking strategies, and world-wide cultural experience has proven key for delivering exceptional service.
Originally founded as an educational production company, Productive Playhouse made a mark with our award winning children’s series, which taught fundamental subjects through engaging and effective programming. This early success paved the way for our evolution into a comprehensive data services provider.
Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services. Our current offerings include transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity. Our commitment to innovation means we continually enhance our service portfolio to meet the evolving needs of our clients.
At Productive Playhouse, we are proud of our reputation for addressing complex challenges with agility and delivering premium, secure data solutions across diverse environments. Our dynamic team is dedicated to maintaining the highest standards and ensuring exceptional service every time.
Disclaimer
This job description is intended to describe the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties, responsibilities, or qualifications. Duties, responsibilities, and scope may change or evolve based on business needs and organizational priorities. Productive Playhouse reserves the right to modify, revise, or reassign responsibilities as necessary, consistent with applicable law.
Equal Employment Opportunity
Productive Playhouse is an equal opportunity employer. We are committed to fostering a diverse, equitable, and inclusive work environment and do not discriminate on the basis of race, color, religion, sex, gender identity or expression, sexual orientation, age, national origin, ancestry, disability, medical condition, genetic information, marital status, military or veteran status, or any other status protected by applicable law.
Employment Relationship
Employment with Productive Playhouse is at-will where permitted by law, meaning that either the employee or the company may terminate the employment relationship at any time, with or without cause or notice. Where local laws require different terms or conditions, the employment relationship will be governed in accordance with applicable legal requirements.
Work Authorization & Verification
All offers of employment are contingent upon the candidate’s ability to provide valid documentation verifying identity and authorization to work in the United States or the applicable hiring location. Productive Playhouse participates in E-Verify where required by law.
Reasonable Accommodation
Productive Playhouse provides reasonable accommodations for qualified individuals with disabilities, in accordance with applicable law. Candidates or employees who require assistance or accommodation to perform the essential functions of the role may contact the Human Resources Department.
Location: Lisbon, Portugal
German AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of German
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in German
, as spoken in Germany.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
London, Greater London, United Kingdom; We welcome applicants of all backgrounds and abilities, regardless of location or engagement type
Istanbul, Turkey; We welcome applicants of all backgrounds and abilities, regardless of location or engagement type
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.