Location: Warsaw, Masovian Voivodeship, Poland
Polish AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Polish speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $14.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Polish, as spoken in Poland
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Warsaw, Masovian Voivodeship, Poland; We welcome applicants of all backgrounds and abilities, regardless of location or engagement type
Location: Yerevan, Armenia
Armenian AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Armenian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $15.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Armenian, as spoken in Armenia
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Taipei, Taipei City, Taiwan
Traditional Chinese AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Traditional Chinese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $11.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Traditional Chinese, as spoken in Taiwan
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Amsterdam, North Holland, Netherlands
Dutch AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Dutch speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Dutch, as spoken in Netherlands
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Chiang Mai, Thailand
Thai AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Thai speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $9.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Thai, as spoken in Thailand
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Berlim, Germany
German AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of German
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in German
, as spoken in Germany.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Tokyo, Japan
Japanese AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Japanese
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $24.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Japanese
, as spoken in Japan.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Bandung, Jawa Barat, Indonesia
Indonesian AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Indonesian
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $10.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Indonesian
, as spoken in Indonesia.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Bengaluru, Karnataka, India
Indian English AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Indian English
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $8.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in English
, as spoken in India.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Grenoble, Auvergne-Rhône-Alpes, France
French AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
French
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in French
, as spoken in France.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: São Paulo, Brazil
Brazilian Portuguese AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Brazilian Portuguese
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $14.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Portuguese, as spoken in Brazil.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: New Delhi, Delhi, India
Hindi AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Hindi
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $8.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Hindi
, as spoken in India.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Cairo, Egypt
Egyptian Arabic AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Egyptian Arabic
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $10.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Arabic, as spoken in Egypt.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Mexico City, CDMX, Mexico
Spanish (LatAm) AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Spanish (LatAm)
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $14.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Spanish
, as spoken in Latin America.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Seoul, South Korea
Korean AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Korean
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Korean, as spoken in South Korea.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Multiple Countries
About Advantage HQ
Advantage HQ is building the next generation of creator-led growth infrastructure for consumer brands.
We combine creative strategy, creator partnerships, performance content, whitelisting, affiliate distribution, paid media, and proprietary technology into one integrated growth system.
Our team manages more than $850 million in annual media spend and works with a network of more than 400,000 creators across Meta, TikTok, and YouTube. Through Meteoric AI, our proprietary intelligence platform, we use data and AI to improve decision-making across creative production, creator selection, customer acquisition, campaign performance, and brand growth.
We work with ambitious consumer brands across health, wellness, beauty, nutrition, personal care, and lifestyle.
The Opportunity
As our client portfolio and media organization grow, we need strong leaders who can help our Media Buying teams operate at a consistently high level.
The Media Buying Team Lead is the first layer of leadership within our media organization. You will lead a team of Media Buyers and Media Analysts, help them solve complex performance challenges, maintain high execution standards, and create the structure they need to do their best work.
This is a hands-on leadership role. You should have strong paid media expertise and still be close enough to campaign performance to coach your team effectively.
What You'll Own
Lead and develop the team
You will manage a team of Media Buyers and Media Analysts, providing regular coaching, feedback, and performance support.
You will understand the strengths and development areas of each team member and help them become more capable and independent operators.
Maintain execution quality
You will review campaign performance, account health, testing activity, and execution quality across your team's portfolio.
You will identify problems early, challenge weak decisions, and ensure the team follows the standards required to deliver strong client outcomes.
Solve complex media problems
You will act as an escalation point when Media Buyers encounter difficult performance or account challenges.
You will help the team diagnose problems, determine the right course of action, and learn from the situation rather than simply providing the answer.
Improve team workflows
You will identify recurring execution issues and work with leadership to improve processes, documentation, and team routines.
You will help create a more consistent way of working across accounts without introducing unnecessary bureaucracy.
Build the next generation of media talent
You will support onboarding and training for new Media Buyers and Analysts and help identify high-potential team members who can take on greater responsibility.
Who You Are
You are an experienced paid media professional who has started taking responsibility for other people's performance.
You understand e-commerce media deeply enough to challenge campaign strategy, interpret performance data, and coach others through difficult decisions.
You are organized, direct, and comfortable holding people accountable. You do not need to personally solve every problem. You know how to help other people become better problem solvers.
Most importantly, you care about both performance and people.
Experience We Value
5+ years of experience in paid media, performance marketing, or a related field
Strong e-commerce media buying experience
Experience with Meta, Google, TikTok, or other major paid media platforms
Experience managing meaningful advertising budgets
Experience mentoring, coaching, or leading media professionals
Strong understanding of performance metrics, testing, optimization, and funnel performance
Strong communication and analytical skills
Experience working with multiple clients or brands
Why Join Advantage HQ
You will have the opportunity to move from being a strong individual contributor into a leadership role while staying close to the media work you know best.
You will work alongside experienced media, creative, growth, and client teams and have the opportunity to help shape how our media organization operates as we scale.
Compensation & Location
$40,000 - $90,000 USD total annual compensation, including base salary, performance bonus, and equity.
Fully remote. We have built the infrastructure for high-performance distributed teams and trust our people to do their best work from wherever they work best.
We are open to candidates globally.
We care far more about ownership, judgment, and execution than geography.
If you're excited by leading talented media professionals, solving performance challenges, improving how teams work, and helping build a stronger media organization, we'd love to hear from you.
Location: El Salvador
The Role
You'll own paid media end to end for a set of DTC and e-commerce accounts: onboarding a new client, building their accounts from scratch, and running live campaigns against revenue targets. You're the person the client speaks to about their spend. You explain what's working, what isn't, and what you're doing about it.
This is a hands-on seat, not an oversight one. You run the accounts yourself.
What You Own
Onboarding a new client
Lead the kickoff: budgets, targets (CPA/ROAS), audiences, and reporting cadence
Audit existing ad accounts, tracking setup, and creative libraries before anything goes live
Agree what good looks like in month one, three, and six
Setting up
Configure ad accounts, pixels, CAPI, and conversion tracking
Build the account structure: campaigns, ad sets, audiences, budget splits
Brief creative and feed requirements to the studio team
Running the account
Launch, monitor, and optimise daily against KPIs
Manage budget pacing and move spend where it performs
Run creative, audience, and bidding tests, then scale what works
Own the weekly and monthly client reporting and walk clients through it
Flag risks early. If a target is slipping, the client hears it from you first, with a plan
What You Need
3+ years buying paid media, hands-on, across Meta and Google (TikTok a plus)
A track record in DTC or e-commerce where you owned ROAS or CPA and can talk through specific accounts
Comfortable running client calls solo, including the difficult ones about performance
Strong on tracking and attribution: GA4, pixel, CAPI, and reading the data behind a result
Able to run several accounts at once, start to finish, and keep each one on plan
Nice to Have
Agency background running multiple clients
Feed management and Google Shopping experience
A creative testing framework you've actually used
Location: Nicaragua
The Role
You'll own paid media end to end for a set of DTC and e-commerce accounts: onboarding a new client, building their accounts from scratch, and running live campaigns against revenue targets. You're the person the client speaks to about their spend. You explain what's working, what isn't, and what you're doing about it.
This is a hands-on seat, not an oversight one. You run the accounts yourself.
What You Own
Onboarding a new client
Lead the kickoff: budgets, targets (CPA/ROAS), audiences, and reporting cadence
Audit existing ad accounts, tracking setup, and creative libraries before anything goes live
Agree what good looks like in month one, three, and six
Setting up
Configure ad accounts, pixels, CAPI, and conversion tracking
Build the account structure: campaigns, ad sets, audiences, budget splits
Brief creative and feed requirements to the studio team
Running the account
Launch, monitor, and optimise daily against KPIs
Manage budget pacing and move spend where it performs
Run creative, audience, and bidding tests, then scale what works
Own the weekly and monthly client reporting and walk clients through it
Flag risks early. If a target is slipping, the client hears it from you first, with a plan
What You Need
3+ years buying paid media, hands-on, across Meta and Google (TikTok a plus)
A track record in DTC or e-commerce where you owned ROAS or CPA and can talk through specific accounts
Comfortable running client calls solo, including the difficult ones about performance
Strong on tracking and attribution: GA4, pixel, CAPI, and reading the data behind a result
Able to run several accounts at once, start to finish, and keep each one on plan
Nice to Have
Agency background running multiple clients
Feed management and Google Shopping experience
A creative testing framework you've actually used
seniorГеография найма не уточнена
Yerevan, Armenia; We welcome applicants of all backgrounds and abilities, regardless of location or engagement type
We welcome applicants of all backgrounds and abilities, regardless of location or engagement type
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.