Location: Petaling Jaya, Kuala Lumpur, Malaysia
Simplified Chinese AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Simplified Chinese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $11.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Simplified Chinese, as spoken in Mainland China
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Petaling Jaya, Kuala Lumpur, Malaysia; We welcome applicants of all backgrounds and abilities, regardless of location or engagement type
Location: Uppsala, Uppland, Sweden
Swedish AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Swedish speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Swedish, as spoken in Sweden
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Tirana, Tirana County, Albania
Albanian AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Albanian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $12.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Albanian, as spoken in Albania
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Granada, Spain
Spanish (Spain) AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Spanish (Spain)
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $15.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Spanish
, as spoken in Spain
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Warsaw, Masovian Voivodeship, Poland
Polish AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Polish speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $14.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Polish, as spoken in Poland
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Yerevan, Armenia
Armenian AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Armenian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $15.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Armenian, as spoken in Armenia
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Taipei, Taipei City, Taiwan
Traditional Chinese AI Product Evaluator
🎯
The Project
Productive Playhouse is building a talent pool of Traditional Chinese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $11.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
✅ What We're Looking For
Native or expert-level fluency in Traditional Chinese, as spoken in Taiwan
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH? 🌍
🌍 Your language skills are the whole point — and this project pays for them
⚡ Apply once, get contacted directly when a spot opens — no chasing
🏠 Work from anywhere, on your own schedule, alongside any other work you do
🤝 Clear task specs, no ongoing oversight, no micromanagement
💼 Real project experience with a global data and language services company
✨ Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Groningen, Netherlands
Dutch AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of Dutch speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Dutch, as spoken in Netherlands
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Lisbon, Portugal
German AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of German
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in German
, as spoken in Germany.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Seongnam-si, Gyeonggi-do, South Korea
Korean AI Product Evaluator
The Project
Productive Playhouse is building a talent pool of
Korean
speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates.
If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!
Open to freelancers based outside the U.S.
This is more than one job. Apply once, and we'll keep you in mind for this project — and future ones that need your language skills.
The Details
We’re looking for independent contractor engagement (task-based - project-based).
Pay Rate: $20.00 USD per hour
100% remote
You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
This is an iterative project, work arrives in batches (there may be pauses between them).
What You’ll Do
As an AI Evaluator, you'll play a critical role in shaping and improving the next generation of Generative AI. You'll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.
Exact tasks vary by project and will be spelled out in that project's Statement of Work (SOW) before you start. Depending on the role, your work may include:
Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.
What We're Looking For
Native or expert-level fluency in Korean, as spoken in South Korea.
Strong English reading, writing, and communication skills - assessment maybe required
18 years of age or older
Hands-on experience using AI models or large language models
Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
Your own smartphone, computer, reliable internet, and comfort with web-based tools
Able to pass a language proficiency and technical literacy assessment
Responsive communicator — quick replies move you through onboarding faster
Able to start within 48 hours
Why PPH?
Your language skills are the whole point — and this project pays for them
Apply once, get contacted directly when a spot opens — no chasing
Work from anywhere, on your own schedule, alongside any other work you do
Clear task specs, no ongoing oversight, no micromanagement
Real project experience with a global data and language services company
Work that actually improves how AI understands your language
About Productive Playhouse
We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.
Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.
All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.
Location: Multiple Countries
About Advantage HQ
Advantage HQ is building the next generation of creator-led growth infrastructure for consumer brands.
We combine creative strategy, creator partnerships, performance content, whitelisting, affiliate distribution, paid media, and proprietary technology into one integrated growth system.
Our team manages more than $850 million in annual media spend and works with a network of more than 400,000 creators across Meta, TikTok, and YouTube. Through Meteoric AI, our proprietary intelligence platform, we use data and AI to improve decision-making across creative production, creator selection, customer acquisition, campaign performance, and brand growth.
We work with ambitious consumer brands across health, wellness, beauty, nutrition, personal care, and lifestyle.
The Opportunity
Advantage HQ is building a media organization that can operate at a level far beyond individual campaign management.
The Head of Media Operations will own that organization.
You will define the operating model for Media Operations, build the leadership structure, establish the systems that govern execution, and ultimately be accountable for the organization's ability to deliver high-quality media performance at scale.
You will work directly with executive leadership and play a central role in determining how Advantage HQ builds, manages, and scales its media capability.
What You'll Own
Define the Media Operations strategy
You will establish the vision, structure, priorities, and operating model for the entire Media Operations organization.
You will determine what the organization needs to look like as Advantage HQ grows and ensure our people, processes, and systems evolve accordingly.
Build the organization
You will design the leadership structure, define roles and responsibilities, hire senior leaders, and develop the management bench required to scale.
You will build an organization that does not depend on a small number of individuals to maintain performance.
Build the operating system
You will own the systems, standards, KPIs, processes, and accountability mechanisms that govern media delivery.
This includes performance management, quality assurance, capacity planning, training, resource allocation, reporting, escalation, and continuous improvement.
Own organizational performance
You will be accountable for the overall health and effectiveness of the Media Operations organization.
You will monitor performance, productivity, quality, capacity, client outcomes, and organizational risks and take action when results fall below expectations.
Drive scale and efficiency
You will identify opportunities to improve productivity, reduce unnecessary operational complexity, automate repetitive work, and use AI to increase the organization's capabilities.
You will balance growth with sustainable team structures and strong client delivery.
Partner with the executive team
You will work directly with executive leadership on organizational planning, business growth, hiring, resource allocation, client delivery, and major operational decisions.
You will bring a clear point of view on what the media organization needs next and why.
Who You Are
You are a senior media and operations leader who has built organizations, not simply managed teams.
You understand paid media and e-commerce deeply enough to maintain credibility with expert practitioners, but your greatest leverage comes from people, systems, structure, and organizational design.
You are commercially minded. You understand that the media organization must deliver strong client outcomes while operating efficiently and sustainably.
You are comfortable with ambiguity, high growth, and significant responsibility. You can make decisions with incomplete information, build structure where none exists, and hold senior leaders accountable for results.
You use technology, data, automation, and AI aggressively when they create meaningful leverage.
Most importantly, you take full ownership. You do not wait for someone else to define the system you need to operate.
Experience We Value
10+ years of experience in paid media, performance marketing, growth, or a related field
5+ years leading large or multi-layer media organizations
Extensive experience with e-commerce and performance marketing
Experience overseeing significant media spend and complex client portfolios
Demonstrated experience building teams, leadership structures, operating systems, and processes
Experience with organizational design, workforce planning, budgeting, and resource allocation
Strong commercial judgment and understanding of agency or growth-business economics
Experience partnering directly with founders, CEOs, or executive leadership
Strong track record of developing senior leaders and building accountable organizations
Experience using technology, automation, data, or AI to improve operational scale
Why Join Advantage HQ
This is an opportunity to build and lead the operating system behind a major media organization.
You will have significant ownership over how Advantage HQ structures its teams, develops its leaders, manages capacity, measures performance, and scales its media capabilities.
You will work directly with executive leadership and have the opportunity to shape a function that sits at the center of the company's ability to deliver growth for its clients.
For the right person, this role can grow into broader operational and commercial leadership across the Advantage HQ platform.
Compensation & Location
$50,000 - $160,000 USD total annual compensation, including base salary, performance bonus, and equity.
Fully remote. We have built the infrastructure for high-performance distributed teams and trust our people to do their best work from wherever they work best.
We are open to candidates globally.
We care far more about ownership, judgment, and execution than geography.
If you're excited by building a high-performing organization, developing leaders, creating systems that scale, and taking ownership of a critical function within a high-growth company, we'd love to hear from you.
Location: Muscatatuck, IN, United States
Operations Manager – II (General and Operations Management)
Why IDS?
IDS believes in solving complex challenges through innovation, technical expertise, and operational excellence. We support critical missions across government and defense sectors, delivering impactful solutions that enhance national security. Joining IDS means contributing to meaningful, mission-driven work in highly dynamic environments.
Location
Muscatatuck Indiana
Job Description
IDS is seeking a skilled
Operations Manager II
to support cyber range and training operations within a Department of Defense (DoD) environment. This role requires a hands-on leader with experience managing cyber training programs, coordinating operational activities, and supporting enterprise-level cyber test and training environments.
The Operations Manager will play a key role in planning, executing, and evaluating cyber training events while ensuring alignment with mission objectives and technical requirements.
Key Responsibilities
Plan, coordinate, and execute
cyber range and training operations
Lead and manage
cyber training programs
for Army and Joint environments
Oversee daily operational activities within
cyber testbed environments
Ensure training effectiveness through
evaluation and continuous improvement
Coordinate with
senior DoD stakeholders and leadership
Support integration of
IT/OT systems, networking, and cyber infrastructure
Manage schedules, resources, and operational priorities
Maintain operational readiness of cyber range capabilities
Requirements
Education
Bachelor’s degree in network engineering, Cybersecurity, Information Management, or related discipline
OR
equivalent experience in lieu of degree
Experience
Minimum of
7 years of experience in cyber range or computer testbed environments
Minimum of
7 years of program management or equivalent senior-level DoD / defense industry experience
Minimum of
2 years of experience supporting Army and Joint cyber training exercises
Strong experience planning, executing, and evaluating
cyber training programs
Experience working with
senior DoD personnel and stakeholders
Demonstrated ability to manage
operations in fast-paced, mission-driven environments
Technical Skills
Working knowledge of:
Operational Technology (OT) / Information Technology (IT)
systems
Networking and infrastructure environments
Cellular systems and communications technologies
Cyber range platforms and test environments
Desired Skills
Strong project and operations management abilities
Excellent leadership and coordination skills
Strong communication and stakeholder engagement
Ability to manage multiple priorities simultaneously
Experience in
training environment optimization and performance improvement
Security Clearance
Active Top Secret (TS) / Sensitive Compartmented Information (SCI)
required
Location: Annapolis Junction, MD, United States
Job Title
Information System Security Engineer (ISSE) – ISSD
Why IDS?
IDS is committed to resolving complex challenges through innovation and operational excellence. We combine deep technical expertise with mission-driven focus to support government, military, nonprofit, and public-sector customers. At IDS, your work directly contributes to strengthening national security and enabling critical intelligence operations.
Location
Annapolis Junction, MD
Shifts Available
Please note, candidates must be flexible. Shift times are general hours; some projects may require earlier or later reporting based on customer requirements.
Job Description
IDS is seeking a skilled
Information System Security Engineer (ISSE)
to support the Information Systems Security Division (ISSD). This role focuses on collaborating with government stakeholders to ensure compliance with security requirements and maintain secure system operations.
The ISSE will play a key role in supporting Risk Management Framework (RMF) processes, completing required security documentation, and conducting system audits to ensure ongoing compliance with federal standards.
Key Duties
Collaborate with internal and external customers to complete required government security documentation and processes
Assist government stakeholders in addressing information system security-related inquiries
Perform regular audits of information systems to ensure compliance with established security controls
Support RMF activities, including documentation, assessments, and system authorization processes
Apply NIST 800-53 Rev. 5 controls to maintain and enhance system security posture
Implement and evaluate Defense-in-Depth strategies across networks and enterprise environments
Support and ensure compliance with Secure Terminal Equipment (STE) / Secure Terminal Node (STN) requirements
Requirements
Bachelor’s degree with eight (8) years of relevant experience, or equivalent combination of education and experience
Strong experience supporting RMF processes and system security engineering activities
Demonstrated experience applying NIST 800‑53 Rev. 5 controls
Understanding of Defense-in-Depth principles and enterprise security architecture
Experience working with network security and secure system design
Familiarity with STE/STN requirements
Ability to support system audits and compliance efforts
Must possess an Information Assurance Manager (IAM) Tier I certification
Desirable Skills
Knowledge of customer-specific corporate tools and data repositories
Experience with Microsoft Office tools (Word, Outlook, Excel)
Strong communication and documentation skills
Ability to work collaboratively with technical teams and government stakeholders
Security Clearance
Active
TS/SCI with Polygraph
required
Location: Saipan, Northern Mariana Islands
WE ARE HIRING INTERPRETER!!!!
As a remote interpreter, you play a significant role in facilitating communication between Carolinian and English speakers. The interpreter needs to be able to process information quickly and with accuracy in a professional manner. It is essential to ensure a quiet & secure environment. Note pads and writing utensils, glossaries, and dictionaries are useful tools.
Requirements:
90% English proficiency.
Steady wired internet connection.
USB Wired headset.
Windows 10 or MacOS.
WHAT WE OFFER YOU:
A fully remote position with a clear schedule.
Full-time or part-time position.
Immediate availability to start working after onboarding.
Monthly payments.
Per minute.
YOUR RESPONSIBILITIES:
Answer calls professionally, acting according to the Interpreter’s code of conduct.
Be aware of the specific vocabulary of the industry the interpreter works with (healthcare and medical one, specifically).
Go into internal professional training.
Communicate and report to your team leader.
YOUR BACKGROUND AND EXPERIENCE:
Proficiency/Bilingual/Native level of English and target language.
1+ years of interpreting experience (Desirable).
High emotional intelligence and tolerance of diverse cultures.
High level of communication, listening, note-taking, and memory retention skills.
WHAT WE OFFER YOU:
A fully remote position with a clear schedule.
Full-time or part-time position.
Immediate availability to start working after onboarding.
Internal training.
Location: Kikapoo Tribal Reservation, OK, United States
WE ARE HIRING US- BASED INTERPRETER!!!!
As a remote interpreter, you play a significant role in facilitating communication between Kickapoo and English speakers. The interpreter needs to be able to process information quickly and with accuracy in a professional manner. It is essential to ensure a quiet & secure environment. Note pads and writing utensils, glossaries, and dictionaries are useful tools.
Requirements:
90% English proficiency.
Steady wired internet connection.
USB Wired headset.
Windows 10 or MacOS.
WHAT WE OFFER YOU:
A fully remote position with a clear schedule.
Full-time or part-time position.
Immediate availability to start working after onboarding.
Monthly payments.
Per minute.
YOUR RESPONSIBILITIES:
Answer calls professionally, acting according to the Interpreter’s code of conduct.
Be aware of the specific vocabulary of the industry the interpreter works with (healthcare and medical one, specifically).
Go into internal professional training.
Communicate and report to your team leader.
YOUR BACKGROUND AND EXPERIENCE:
Proficiency/Bilingual/Native level of English and target language.
1+ years of interpreting experience (Desirable).
High emotional intelligence and tolerance of diverse cultures.
High level of communication, listening, note-taking, and memory retention skills.
WHAT WE OFFER YOU:
A fully remote position with a clear schedule.
Full-time or part-time position.
Immediate availability to start working after onboarding.
Internal training.
Location: Minneapolis-Saint Paul, MN, United States
WE ARE HIRING US- BASED INTERPRETER!!!!
As a remote interpreter, you play a significant role in facilitating communication between Hmong and English speakers. The interpreter needs to be able to process information quickly and with accuracy in a professional manner. It is essential to ensure a quiet & secure environment. Note pads and writing utensils, glossaries, and dictionaries are useful tools.
Requirements:
90% English proficiency.
Steady wired internet connection.
USB Wired headset.
Windows 10 or MacOS.
WHAT WE OFFER YOU:
A fully remote position with a clear schedule.
Full-time or part-time position.
Immediate availability to start working after onboarding.
Monthly payments.
Per minute.
YOUR RESPONSIBILITIES:
Answer calls professionally, acting according to the Interpreter’s code of conduct.
Be aware of the specific vocabulary of the industry the interpreter works with (healthcare and medical one, specifically).
Go into internal professional training.
Communicate and report to your team leader.
YOUR BACKGROUND AND EXPERIENCE:
Proficiency/Bilingual/Native level of English and target language.
1+ years of interpreting experience (Desirable).
High emotional intelligence and tolerance of diverse cultures.
High level of communication, listening, note-taking, and memory retention skills.
WHAT WE OFFER YOU:
A fully remote position with a clear schedule.
Full-time or part-time position.
Immediate availability to start working after onboarding.
Internal training.
Location: Majuro, Marshall Islands
WE ARE HIRING AN INTERPRETER!!!!
As a remote interpreter, you play a significant role in facilitating communication between Marshallese and English speakers. The interpreter needs to be able to process information quickly and with accuracy in a professional manner. It is essential to ensure a quiet & secure environment. Note pads and writing utensils, glossaries, and dictionaries are useful tools.
Requirements:
90% English proficiency.
Steady, wired internet connection.
USB Wired headset.
Windows 10 or MacOS.
WHAT WE OFFER YOU:
A fully remote position with a clear schedule.
Full-time or part-time position.
Immediate availability to start working after onboarding.
Monthly payments.
Per minute.
YOUR RESPONSIBILITIES:
Answer calls professionally, acting according to the Interpreter’s code of conduct.
Be aware of the specific vocabulary of the industry the interpreter works with (specifically, healthcare and medical).
Go into internal professional training.
Communicate and report to your team leader.
YOUR BACKGROUND AND EXPERIENCE:
Proficiency/Bilingual/Native level of English and target language.
1+ years of interpreting experience (Desirable).
High emotional intelligence and tolerance of diverse cultures.
High level of communication, listening, note-taking, and memory retention skills.
WHAT WE OFFER YOU:
A fully remote position with a clear schedule.
Full-time or part-time position.
Immediate availability to start working after onboarding.
Internal training.
Location: Hà Giang, Viet Nam
WE ARE HIRING HMONG NTERPRETERS!!!!
As a remote interpreter, you play a significant role in facilitating communication between Hmong and English speakers. The interpreter needs to be able to process information quickly and with accuracy in a professional manner. It is essential to ensure a quiet & secure environment. Note pads and writing utensils, glossaries, and dictionaries are useful tools.
Requirements:
90% English proficiency.
Steady wired internet connection.
USB Wired headset.
Windows 10 or MacOS.
WHAT WE OFFER YOU:
A fully remote position with a clear schedule.
Full-time or part-time position.
Immediate availability to start working after onboarding.
Monthly payments.
Hourly
YOUR RESPONSIBILITIES:
Answer calls professionally, acting according to the Interpreter’s code of conduct.
Be aware of the specific vocabulary of the industry the interpreter works with (healthcare and medical one, specifically).
Go into internal professional training.
Communicate and report to your team leader.
YOUR BACKGROUND AND EXPERIENCE:
Proficiency/Bilingual/Native level of English and target language.
1+ years of interpreting experience (Desirable).
High emotional intelligence and tolerance of diverse cultures.
High level of communication, listening, note-taking, and memory retention skills.
WHAT WE OFFER YOU:
A fully remote position with a clear schedule.
Full-time or part-time position.
Immediate availability to start working after onboarding.
Internal training.
Hà Giang, Viet Nam
Uppsala, Uppland, Sweden; We welcome applicants of all backgrounds and abilities, regardless of location or engagement type
Tirana, Tirana County, Albania; We welcome applicants of all backgrounds and abilities, regardless of location or engagement type
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.