Location: Madrid
Workplace: remote
We are looking for Generative Audio Evaluation Specialists! A great entry point into ongoing work within one of our most active AI markets!
Job Type: Freelance
Location: Remote (Spain)
Work Schedule: Part-time - 10+ hours per week. Flexible - work whenever you want!
Rate: 12 USD/hour
Help Shape the Future of AI
We’re currently hiring Generative Audio Evaluators to join a highly specialized evaluation project focused on testing and assessing the performance of a cutting-edge generative audio model. Your work will play an important role in identifying performance issues and providing feedback that can help improve the model.
What You’ll Be Doing
You will evaluate AI-generated audio for short video and text-to-audio tasks, following detailed project guidelines. Your main responsibilities will include:
Audio Quality & Naturalness: Assess speech, background music, and sound effects for clarity, quality, and naturalness.
Audio-Video Alignment: Evaluate synchronization between the generated audio and video, including lip-sync and timing.
Caption Compliance: Check whether the generated audio accurately follows the provided text captions and task requirements.
Voice Quality: Evaluate whether generated voices sound natural and, where applicable, match the reference audio.
Evaluation & Feedback: Assign accurate scores and identify issues according to the provided evaluation guidelines.
What We’re Looking For
Native-level fluency in Spanish
Strong attention to detail and excellent listening skills
Ability to follow detailed evaluation guidelines consistently
Good understanding of spoken language, audio quality, and context
Reliable equipment — high-quality headphones are required
Ability to complete the evaluation test within 48 hours of receiving the assignment
Qualification Process
Application
(You are here!)
Screening Survey
Language Knowledge Assessments
Target Language
English
RWS Vendor Onboarding
Internal Testing
Project-specific testing will be required, such as TTS Evaluation, Audio Evaluation, or Transcription Testing.
Vendor Type
When applying, please select the option that best describes your working status.
Are you a Freelancer or Private Individual?
A Freelancer is someone who has a business license and may have a VAT number or EIN for tax purposes. A VAT (Value Added Tax) number is a unique identifier assigned to a registered business in many countries; an EIN (Employer Identification Number) is a similar identifier used in the US. A Private Individual does not have a business license. If you aren’t sure, you are probably a private individual.
RWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics.
Location: Brazil (Remote)
Workplace: Remote
ABOUT THE OPPORTUNITY
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches.
Note this is a remote, freelance opportunity
WHAT YOU’LL DELIVER
- Task Engineering: Evaluating Coding Agents.
- Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling.
- Prompting & Translation: finding failure points where AI does not work, in your native language
- Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary).
- Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus).
- Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.
QUALIFICATIONS
- Experience: 1+ years of industry experience in software or prompt engineering.
- Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
- Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency.
- Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing.
- Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
- Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including:
- Encoding/decoding robustness and Unicode normalization.
- Locale-dependent conventions (collation, casing, non-Gregorian dates).
- Text I/O, toolchain interoperability, and safe string operations.
- (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts.
WHY COLLABORATE WITH LILT?
- Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging.
- Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices.
- Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate.
- Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together.
- Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains.
- Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
WHAT TO CONSIDER BEFORE APPLYING
- Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed.
- Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit.
- Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging.
HOW TO JOIN OUR EXPERT COMMUNITY
1 - Submit your application including an updated copy of your CV in English
2 - Next, complete a GenAI assessment to evaluate your skills
3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects.
AI is changing how the world communicates — and LILT is leading that transformation.
LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.
Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
Location: Switzerland (Remote)
Workplace: Remote
ABOUT THE OPPORTUNITY
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches.
Note this is a remote, freelance opportunity
WHAT YOU’LL DELIVER
- Task Engineering: Evaluating Coding Agents.
- Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling.
- Prompting & Translation: finding failure points where AI does not work, in your native language
- Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary).
- Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus).
- Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.
QUALIFICATIONS
- Experience: 1+ years of industry experience in software or prompt engineering.
- Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
- Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency.
- Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing.
- Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
- Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including:
- Encoding/decoding robustness and Unicode normalization.
- Locale-dependent conventions (collation, casing, non-Gregorian dates).
- Text I/O, toolchain interoperability, and safe string operations.
- (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts.
WHY COLLABORATE WITH LILT?
- Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging.
- Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices.
- Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate.
- Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together.
- Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains.
- Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
WHAT TO CONSIDER BEFORE APPLYING
- Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed.
- Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit.
- Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging.
HOW TO JOIN OUR EXPERT COMMUNITY
1 - Submit your application including an updated copy of your CV in English
2 - Next, complete a GenAI assessment to evaluate your skills
3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects.
AI is changing how the world communicates — and LILT is leading that transformation.
LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.
Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
Location: Austria
Workplace: Remote
ABOUT THE OPPORTUNITY
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches.
Note this is a remote, freelance opportunity
WHAT YOU’LL DELIVER
- Task Engineering: Evaluating Coding Agents.
- Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling.
- Prompting & Translation: finding failure points where AI does not work, in your native language
- Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary).
- Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus).
- Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.
QUALIFICATIONS
- Experience: 1+ years of industry experience in software engineering.
- Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
- Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency.
- Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing.
- Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
- Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including:
- Encoding/decoding robustness and Unicode normalization.
- Locale-dependent conventions (collation, casing, non-Gregorian dates).
- Text I/O, toolchain interoperability, and safe string operations.
- (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts.
WHY COLLABORATE WITH LILT?
- Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging.
- Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices.
- Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate.
- Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together.
- Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains.
- Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
WHAT TO CONSIDER BEFORE APPLYING
- Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed.
- Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit.
- Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging.
HOW TO JOIN OUR EXPERT COMMUNITY
1 - Submit your application including an updated copy of your CV in English
2 - Next, complete a GenAI assessment to evaluate your skills
3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects.
AI is changing how the world communicates — and LILT is leading that transformation.
LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.
Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
Location: Mexico (Remote)
Workplace: Remote
ABOUT THE OPPORTUNITY
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches.
Note this is a remote, freelance opportunity
WHAT YOU’LL DELIVER
- Task Engineering: Evaluating Coding Agents.
- Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling.
- Prompting & Translation: finding failure points where AI does not work, in your native language
- Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary).
- Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus).
- Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.
QUALIFICATIONS
- Experience: 1+ years of industry experience in software engineering.
- Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
- Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency.
- Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing.
- Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
- Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including:
- Encoding/decoding robustness and Unicode normalization.
- Locale-dependent conventions (collation, casing, non-Gregorian dates).
- Text I/O, toolchain interoperability, and safe string operations.
- (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts.
WHY COLLABORATE WITH LILT?
- Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging.
- Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices.
- Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate.
- Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together.
- Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains.
- Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
WHAT TO CONSIDER BEFORE APPLYING
- Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed.
- Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit.
- Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging.
HOW TO JOIN OUR EXPERT COMMUNITY
1 - Submit your application including an updated copy of your CV in English
2 - Next, complete a GenAI assessment to evaluate your skills
3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects.
AI is changing how the world communicates — and LILT is leading that transformation.
LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.
Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
Location: Argentina (Remote)
Workplace: Remote
ABOUT THE OPPORTUNITY
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches.
Note this is a remote, freelance opportunity
WHAT YOU’LL DELIVER
- Task Engineering: Evaluating Coding Agents.
- Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling.
- Prompting & Translation: finding failure points where AI does not work, in your native language
- Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary).
- Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus).
- Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.
QUALIFICATIONS
- Experience: 1+ years of industry experience in software engineering.
- Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
- Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency.
- Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing.
- Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
- Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including:
- Encoding/decoding robustness and Unicode normalization.
- Locale-dependent conventions (collation, casing, non-Gregorian dates).
- Text I/O, toolchain interoperability, and safe string operations.
- (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts.
WHY COLLABORATE WITH LILT?
- Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging.
- Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices.
- Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate.
- Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together.
- Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains.
- Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
WHAT TO CONSIDER BEFORE APPLYING
- Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed.
- Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit.
- Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging.
HOW TO JOIN OUR EXPERT COMMUNITY
1 - Submit your application including an updated copy of your CV in English
2 - Next, complete a GenAI assessment to evaluate your skills
3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects.
AI is changing how the world communicates — and LILT is leading that transformation.
LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.
Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
Location: Belgium (Remote)
Workplace: Remote
ABOUT THE OPPORTUNITY
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches.
Note this is a remote, freelance opportunity
WHAT YOU’LL DELIVER
- Task Engineering: Evaluating Coding Agents.
- Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling.
- Prompting & Translation: finding failure points where AI does not work, in your native language
- Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary).
- Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus).
- Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.
QUALIFICATIONS
- Experience: 1+ years of industry experience in software engineering.
- Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
- Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency.
- Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing.
- Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
- Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including:
- Encoding/decoding robustness and Unicode normalization.
- Locale-dependent conventions (collation, casing, non-Gregorian dates).
- Text I/O, toolchain interoperability, and safe string operations.
- (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts.
WHY COLLABORATE WITH LILT?
- Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging.
- Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices.
- Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate.
- Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together.
- Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains.
- Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
WHAT TO CONSIDER BEFORE APPLYING
- Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed.
- Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit.
- Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging.
HOW TO JOIN OUR EXPERT COMMUNITY
1 - Submit your application including an updated copy of your CV in English
2 - Next, complete a GenAI assessment to evaluate your skills
3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects.
AI is changing how the world communicates — and LILT is leading that transformation.
LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.
Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
Location: Canada (Remote)
Workplace: Remote
ABOUT THE OPPORTUNITY
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches.
Note this is a remote, freelance opportunity
WHAT YOU’LL DELIVER
- Task Engineering: Evaluating Coding Agents.
- Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling.
- Prompting & Translation: finding failure points where AI does not work, in your native language
- Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary).
- Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus).
- Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.
QUALIFICATIONS
- Experience: 1+ years of industry experience in software engineering.
- Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
- Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency.
- Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing.
- Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
- Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including:
- Encoding/decoding robustness and Unicode normalization.
- Locale-dependent conventions (collation, casing, non-Gregorian dates).
- Text I/O, toolchain interoperability, and safe string operations.
- (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts.
WHY COLLABORATE WITH LILT?
- Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging.
- Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices.
- Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate.
- Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together.
- Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains.
- Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
WHAT TO CONSIDER BEFORE APPLYING
- Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed.
- Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit.
- Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging.
HOW TO JOIN OUR EXPERT COMMUNITY
1 - Submit your application including an updated copy of your CV in English
2 - Next, complete a GenAI assessment to evaluate your skills
3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects.
AI is changing how the world communicates — and LILT is leading that transformation.
LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.
Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
Location: France (Remote)
Workplace: Remote
ABOUT THE OPPORTUNITY
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches.
Note this is a remote, freelance opportunity
WHAT YOU’LL DELIVER
- Task Engineering: Evaluating Coding Agents.
- Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling.
- Prompting & Translation: finding failure points where AI does not work, in your native language
- Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary).
- Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus).
- Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.
QUALIFICATIONS
- Experience: 1+ years of industry experience in software engineering.
- Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
- Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency.
- Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing.
- Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
- Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including:
- Encoding/decoding robustness and Unicode normalization.
- Locale-dependent conventions (collation, casing, non-Gregorian dates).
- Text I/O, toolchain interoperability, and safe string operations.
- (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts.
WHY COLLABORATE WITH LILT?
- Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging.
- Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices.
- Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate.
- Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together.
- Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains.
- Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
WHAT TO CONSIDER BEFORE APPLYING
- Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed.
- Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit.
- Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging.
HOW TO JOIN OUR EXPERT COMMUNITY
1 - Submit your application including an updated copy of your CV in English
2 - Next, complete a GenAI assessment to evaluate your skills
3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects.
AI is changing how the world communicates — and LILT is leading that transformation.
LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.
Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
Location: Indonesia (Remote)
Workplace: Remote
ABOUT THE OPPORTUNITY
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches.
Note this is a remote, freelance opportunity
WHAT YOU’LL DELIVER
- Task Engineering: Evaluating Coding Agents.
- Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling.
- Prompting & Translation: finding failure points where AI does not work, in your native language
- Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary).
- Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus).
- Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.
QUALIFICATIONS
- Experience: 1+ years of industry experience in software engineering.
- Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
- Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency.
- Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing.
- Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
- Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including:
- Encoding/decoding robustness and Unicode normalization.
- Locale-dependent conventions (collation, casing, non-Gregorian dates).
- Text I/O, toolchain interoperability, and safe string operations.
- (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts.
WHY COLLABORATE WITH LILT?
- Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging.
- Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices.
- Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate.
- Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together.
- Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains.
- Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
WHAT TO CONSIDER BEFORE APPLYING
- Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed.
- Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit.
- Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging.
HOW TO JOIN OUR EXPERT COMMUNITY
1 - Submit your application including an updated copy of your CV in English
2 - Next, complete a GenAI assessment to evaluate your skills
3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects.
AI is changing how the world communicates — and LILT is leading that transformation.
LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.
Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
Location: Vladivostok
Workplace: onsite
ABOUT US
Xsolla is a global commerce company with robust tools and services to help developers solve the inherent challenges of the video game industry. From indie to AAA, companies partner with Xsolla to help them fund, distribute, market, and monetize their games. Grounded in the belief in the future of video games, Xsolla is resolute in the mission to bring opportunities together, and continually make new resources available to creators. Headquartered and incorporated in Los Angeles, California, Xsolla operates as the merchant of record and has helped over 1,500+ game developers to reach more players and grow their businesses around the world. With more paths to profits and ways to win, developers have all the things needed to enjoy the game.
For more information, visit xsolla.com.
ABOUT YOU
We are looking for a Product / Web Designer at junior level to join our APAC Partnerships team in Vladivostok, working with our HQ Design team. This role is the design half of a two-person build pair: you and the Partnerships Backend Engineer take an inbound partnerships inquiry and turn it into something a player actually sees — a co-branded web shop, a campaign landing page, a creator or affiliate destination page — and ship it together.
You will design conversion-oriented commerce surfaces for the Traffic Source Partners we onboard, adapt Xsolla and partner brand systems into one coherent look per campaign, and build a reusable component library so the next campaign launches faster than the last one. You will hand off to engineering with real specs and then review the implementation until it matches.
This is an entry-level design role with a live audience. We care more about your portfolio and your eye than your years of experience — recent graduates and self-taught designers with strong work are welcome. If you like designing things that get measured, and you want to see your work convert real traffic in APAC markets, we would love to hear from you.
RESPONSIBILITIES
Design partner-facing surfaces
Design the frontend surfaces created for Traffic Source partnerships: co-branded web shop themes, campaign landing pages, affiliate and creator destination pages, promotional banners, and in-shop merchandising.
Design responsive, mobile-first layouts with the purchase funnel in mind — clarity, hierarchy, trust signals, and a short path to checkout.
Adapt Xsolla brand guidelines and each partner's brand into a single coherent visual system per campaign, without breaking either.
Localise and adapt designs for APAC markets, accounting for language length, local conventions, and regional payment and merchandising context.
Ship with engineering
Work directly with the Partnerships Backend Engineer to take designs from Figma into working frontend — provide specs, states, breakpoints, tokens, and exported assets, then review the build until it matches the design.
Build and maintain a reusable component and template library so new partner campaigns can be assembled rather than designed from scratch.
QA implemented pages across browsers and devices and raise the gaps.
Supporting work
Create supporting collateral for partnerships inquiries: pitch visuals, one-pagers, deck slides, and social or creator kit assets.
Collaborate with HQ Design, follow and contribute to the Xsolla design system, and keep design files, naming, and handoff documentation organised.
Take feedback constructively from HQ Design, Partnerships, and partners, and iterate quickly.
Track work in Jira and keep design documentation current in Confluence.
REQUIREMENTS
1–4 years of experience in product, web, or UI design, or a strong portfolio of personal, freelance, or academic work. A portfolio is required for this application.
Proficiency in Figma — components, auto-layout, variants, and prototyping.
Solid grounding in layout, typography, visual hierarchy, colour, and responsive / mobile-first design.
Working knowledge of Adobe Creative Suite (Photoshop, Illustrator) for asset production.
An understanding of what makes a landing page convert, and a willingness to have your design judged on that.
Able to work within an existing design system and brand guidelines rather than around them.
Attention to detail and a high standard of quality in design execution.
English sufficient for daily collaboration with the HQ Design team; Russian for day-to-day work in the Vladivostok office.
Based in, or willing to relocate to, Vladivostok for an onsite role.
NICE TO HAVE
Basic HTML and CSS — enough to spec accurately and QA an implementation.
Motion and micro-interaction work (After Effects, Framer Motion, Rive, Lottie).
Experience designing e-commerce, storefront, or checkout flows.
Experience with marketing landing pages, A/B testing, or conversion optimisation.
Illustration, 3D, or custom asset creation skills.
Familiarity with the gaming industry, creator and influencer marketing, or affiliate campaigns.
Additional languages relevant to APAC coverage (Korean, Chinese, Japanese).
Professional education in design or a related field.
BENEFITS
We are passionate about fostering a supportive environment for our team, so we prioritize the physical, mental, and emotional well-being of our employees and their families through a comprehensive Benefits Program. This includes 100% company-paid medical, dental, and vision plans, Flexible Time Off, and a personalized career roadmap for each employee. By investing in professional development through training and educational opportunities, we ensure that our team thrives both personally and professionally. Together, we’re not just building a business; we’re cultivating a community that values creativity, collaboration, and the transformative power of play.
Benefits
Convenient working tools:
New Mac laptop and any other necessary equipment for your efficient work.
Google Workspace, Atlassian, Jira, Slack
Professional growth:
Paid professional training and attendance at specialized conferences
Exchange of experience between employees within the company
Opportunity for professional growth within the company and department
Obtaining expertise in various areas and products of the company
More perks
Possibility of flexibility working
Access to the corporate library
Health & dental insurance
No dress code
Comfortable and new office environment
The duties and responsibilities of this position may evolve over time to support the organization's goals and individual growth. This job description is intended to outline the general nature and level of work being performed and is not intended to be an exhaustive list of all duties, responsibilities, and qualifications required. By submitting your application, you consent to Xsolla conducting background checks, where permitted by law, after the final interview stage. All checks will comply with local regulations, and your information will be handled confidentially. Xsolla takes your privacy seriously and will not sell or externally distribute any personal data received during the hiring process. In accordance with applicable data protection laws, Xsolla is committed to protecting your personal information and respecting your privacy.
For any inquiries related to data privacy, please contact: careers@xsolla.com
Explore more opportunities at: https://xsolla.com/careers
Location: Remote in EMEA
Location: This is a 100% remote role and is open to candidates residing in EMEA. Visa sponsorship is not available.
About the job
Testlio's fully managed crowdsourced testing platform integrates expert, on-demand testers directly into your release process. Ship faster and more confidently with global coverage across 600,000+ devices, 800+ payment methods, 150+ countries, and 100+ languages. To learn more, visit
www.testlio.com
.
We are seeking an Engineering Manager to lead the team that owns every way the outside world connects to Testlio: our partner integrations, our public API, our identity and access surfaces. If a client’s Jira, a client’s CI pipeline, a client’s engineer, or a client’s AI agent touches Testlio, it goes through your team’s systems. This role reports to the Director, Engineering.
Why will you love this job?
Own the platform’s contract with the world. You’ll lead the one team that covers the whole programmatic perimeter: bi-directional sync with a dozen tools (Jira, Xray, Azure DevOps, GitHub, GitLab, Asana, Linear, Monday, TestRail, Trello, YouTrack, Slack), enterprise SSO, our public API.
Build the API as a product, not a byproduct. We have a written public-API strategy: OpenAPI contracts as the source of truth, major and dated versioning, uniform auth, granular API roles, rate limiting, end-to-end request tracing.
Make support self-serve. You’ll cut recurring support work at the source, with self-serve setup and diagnostics, integration health visible to the people who need it, and automation and permanent fixes instead of repeat manual triage.
Partner with product and with real customers. You’ll work closely with a dedicated product manager on discovery, prioritization, and outcomes, and also directly with enterprise client engineering teams who build against our API.
Why will you love being a part of Testlio?
Great Culture:
Testlio is a female-founded company, and half of our team identifies as women. We’re proud of our
inclusive, purpose-driven culture
where people genuinely enjoy collaborating. As part of our team (we call ourselves TestLions), you’ll help create exceptional digital experiences for our customers, while also contributing to our freelance network.
Remote Work:
Our culture is built around remote work. We’ve created systems to allow us to successfully work together asynchronously as a
fully remote and globally distributed team.
Testlio provides the tools and guidance for everyone to succeed in their careers in a fully remote setting. Our working style encourages everyone to make decisions, communicate effectively, and work at a sustainable pace.
Investment in You:
Your growth and well-being matter to us. You’ll have flexible paid time off—including national holidays, personal days, and sick days—plus stock options so you can grow with Testlio. We also provide a $300 annual learning stipend to support your personal and professional development.
Winning Business:
Testlio is growing, profitable, and cash-strong. We are leading our industry with
exceptional clients
who provide us with a high NPS score and a 4.7 rating on G2. Our business model is global, enterprise, and subscription-based. Several of our largest clients have been with us for 7+ years, and many spend $500K+/year with Testlio.
What would your day look like?
Shaping what's next
Stay close to the code:
Expect to spend roughly 20–30% of your time on hands-on engineering, including writing production code, providing substantive reviews on critical-path pull requests, and signing off on key technical designs. You'll help remove critical technical bottlenecks and contribute directly when needed, while empowering the team to own and deliver work independently.
Public API strategy:
Own Testlio's public API end to end: OpenAPI specifications kept current in every service repo and treated as the consumer contract, a coherent versioning and deprecation policy, consistent authentication and authorization on every endpoint, rate limiting, and traceability across the request path.
Integration architecture:
Set the multi-quarter technical direction for a sync platform that must stay correct across a dozen third-party APIs, each with its own data model, rate limits, and release cadence. Reduce per-vendor special-casing in favour of a common mapping and sync core.
Roadmap ownership:
Turn strategy into a sequenced roadmap with your product partner, and own technical delivery from concept to production.
Running it with rigor
Engineering operating rhythm:
Establish effective planning, prioritization, and design review practices that balance delivery speed with long-term scalability.
Technical leadership:
Combine engineering vision and team mentorship with hands-on technical contribution, staying close to the codebase to understand the team's work and make informed technical decisions.
Third-party dependency management
: Own the risk that comes with depending on other people's APIs. Track vendor changelogs, deprecations and sunset dates, plan migrations before they become incidents, and keep credential, token, and connection failures from turning into client-visible outages.
Production support and escalations:
Own production support for your domains, including triage, escalation management, and root-cause resolution. Drive automation, self-serve setup, and permanent fixes that measurably reduce recurring support volume and improve operational efficiency.
Reliability and observability:
Define service level objectives for sync freshness, sync success rate, and API availability and latency; build the dashboards that make integration health self-serve; and lead root-cause analysis on production issues.Engineering standards: Ensure work is traceable and the Definition of Done is consistently met, minimizing escaped defects and keeping cloud costs in check.
Team growth:
Coach engineers technically, bring AI-assisted development workflows (e.g., Claude Code) into daily practice, and reduce knowledge silos through reviews and documentation.
What do you need to succeed?
Technical skills
Engineering management:
5+ years managing a team of 4+ engineers in an agile, remote environment.
Hands-on technical leadership:
Recent experience writing production code and designing or evolving production systems. You are comfortable working directly in the codebase, contributing to implementation, reviewing code, and making architectural decisions alongside your team.
Public or partner-facing API ownership:
Proven experience designing, versioning, documenting, and deprecating APIs consumed by people outside your own company. You've made a breaking-change decision and lived with the consequences. OpenAPI, idempotency, pagination, webhooks, and rate limiting are familiar ground.
Third-party integration systems:
Experience building or running integrations against external APIs at scale: OAuth flows, credential storage and rotation, retries and backoff, queue and poison-message handling, conflict resolution in bi-directional sync, and per-tenant blast-radius control.
Technical stack:
Strong affinity with TypeScript and Node.js on AWS, including serverless (Lambda), DynamoDB, and event-driven patterns.
Nice-to-haves
Identity and access:
Practical knowledge of OAuth 2.0, OIDC, SAML, and enterprise SSO, plus token scoping and least-privilege API roles.
Broader stack familiarity:
Kafka, GraphQL, Python, and React are a plus.
Observability and performance:
Experience with observability and APM tools (e.g., New Relic, Datadog, Sentry) and optimizing slow database transactions.
Application security:
Knowledge of application security best practices and integrating security review into the SDLC.
Legacy modernization:
Experience modernizing legacy systems or paying down significant technical debt while keeping a product running.
SaaS experience:
Prior experience managing a SaaS product is a plus.
Human skills
Fluency in English, with excellent written and verbal communication.
Collaborative. Works effectively with product management and cross-functional partners in a distributed, asynchronous setting.
Organized and thorough, with a meticulous approach to standards and process.
Growth catalyst. Passionate about team productivity, technical excellence, and continuous improvement.
Results-oriented, with data-driven decision-making.
What is the application process?
We do our best to bring on individuals who are excited about their role and have the potential for a great future with Testlio. Since we are 100% distributed, you'll meet with several people from our organization so you get a clear picture of who you'd work with and what the role expects. Our process typically takes 3 to 4 weeks.
Application review
Recruiter interview
Hiring Manager Interview
Live Technical Exercise
2 team and stakeholder interviews
Reference checks
Offer
Diversity and inclusion
Testlio is an equal-opportunity employer deeply committed to creating an inclusive environment for people of all backgrounds and identities. We are female-founded, and 46% of our team members identify as women. For more information, see the
DEI section
of our website.
#LI-Remote
Location: France
Have you ever wished an app worked a little better?
At
Testlio
, we help some of the world's leading technology and consumer brands improve their apps and digital products by collecting feedback from real people. Our global community of freelance testers has helped companies deliver better experiences to millions of users.
We're currently looking for people
based in France
to help test a regional streaming platform that offers both on-demand and live content. Testing may include evaluating overall application stability, user experience, playback behavior, and localization quality on
Samsung AND/OR Hisense Smart TV
environments.
No professional software testing experience is required.
If you're comfortable following instructions and sharing feedback, we'd love to hear from you.
Requirements:
You must own or have direct access to a Samsung Smart TV with Tizen OS AND/OR Hisense Smart TV with Vidaa OS
You must be physically located in France.
You should be proficient in French and able to speak and understand the language well enough to perform localization testing.
What does testing look like?
Type of testing: streaming testing.
Type of work: short-term, freelance.
Workload: To be confirmed based on future testing needs
Pay rate: The pay rate for this is 18 USD/hr.
Payment: You are paid weekly via PayPal or Payoneer.
We will send you the USD amount, which you can then transfer/convert to EUR if it is more convenient to you.
Benefits of being a freelancer at Testlio
Schedule: You can create your schedule and work on other testing runs that interest you.
Location: Testlio is a 100% remote company. Seriously, you can work from the coffee shop, your home, or while waiting for class.
Growth: You’ll be testing global-scale mobile apps and have the chance to boost your skills and grow your career.
Payment: You are paid by the hour, not by the bug. This means you get paid even if you did not uncover any bugs.
How to start?
Please fill out the initial application. Those who meet the requirements will receive further information to participate in this paid testing opportunity.
#LI-REMOTE
Location: Lahore, Pakistan; Karachi, Pakistan
You will be a practitioner on our telehealth platform 'Intellect', where your role is to support our clients' mental health and personal growth based on the individual needs and goals. This is delivered primarily through scheduled 60-minute video sessions on our platform.
This is a freelance remote role with the flexibility to decide your business hours. Local candidates are preferred but others can still be considered. This role is a great opportunity to supplement your current job or private practice.
We're seeking to partner with Clinical Psychologists and Counsellors to be part of a community working collaboratively to bring greater mental health access to the public to provide mental health coaching.
What You'll Do
Provide 1-on-1 telehealth/or onsite mental health support for Intellect’s clients
Focus on clinical cases such as depression, anxiety, trauma, schizophrenia, eating disorders, addiction etc.
Collaboratively work with the internal clinical team by suggesting improvements to the program and the platform
Requirements
Has a Master / Postgraduate Diploma training in Clinical Psychology
3 years post master's degree experience
Has experience working with psychological topics like depression, OCD, PTSD, and the like
Skilled in Cognitive Behavioural Therapy or other evidence-based approaches (e.g. Motivational Interviewing, DBT, SFBT, etc.)
Candidate must have at least 300 clinical hours
Able to do occasional onsite sessions
Candidate must be proficient in Urdu and Seraiki language
Prior experience in EAP, and/or counselling working
Location: Amsterdam
Workplace: remote
We are looking for Generative Audio Evaluation Specialists! A great entry point into ongoing work within one of our most active AI markets!
Job Type: Freelance
Location: Remote (The Netherlands)
Work Schedule: Part-time - 10+ hours per week. Flexible - work whenever you want!
Rate: 19 USD/hour
Help Shape the Future of AI
We’re currently hiring AI Generalists to join a highly specialized evaluation project focused on testing and assessing the performance of a cutting-edge generative audio model. Your work will play an important role in identifying performance issues and providing feedback that can help improve the model.
What You’ll Be Doing
You will evaluate AI-generated audio for short video and text-to-audio tasks, following detailed project guidelines. Your main responsibilities will include:
Audio Quality & Naturalness: Assess speech, background music, and sound effects for clarity, quality, and naturalness.
Audio-Video Alignment: Evaluate synchronization between the generated audio and video, including lip-sync and timing.
Caption Compliance: Check whether the generated audio accurately follows the provided text captions and task requirements.
Voice Quality: Evaluate whether generated voices sound natural and, where applicable, match the reference audio.
Evaluation & Feedback: Assign accurate scores and identify issues according to the provided evaluation guidelines.
What We’re Looking For
Native-level fluency in Dutch
Strong attention to detail and excellent listening skills
Ability to follow detailed evaluation guidelines consistently
Good understanding of spoken language, audio quality, and context
Reliable equipment — high-quality headphones are required
Ability to complete the evaluation test within 48 hours of receiving the assignment
Qualification Process
Application
(You are here!)
Screening Survey
Language Knowledge Assessments
Target Language
English
RWS Vendor Onboarding
Internal Testing
Project-specific testing will be required, such as TTS Evaluation, Audio Evaluation, or Transcription Testing.
#LI-CAN17
Vendor Type
When applying, please select the option that best describes your working status.
Are you a Freelancer or Private Individual?
A Freelancer is someone who has a business license and may have a VAT number or EIN for tax purposes. A VAT (Value Added Tax) number is a unique identifier assigned to a registered business in many countries; an EIN (Employer Identification Number) is a similar identifier used in the US. A Private Individual does not have a business license. If you aren’t sure, you are probably a private individual.
RWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics.
Location: Warsaw
Workplace: remote
We are looking for Generative Audio Evaluation Specialists! A great entry point into ongoing work within one of our most active AI markets!
Job Type: Freelance
Location: Remote (Poland)
Work Schedule: Part-time - 10+ hours per week. Flexible - work whenever you want!
Rate: 11USD/hour
Help Shape the Future of AI
We’re currently hiring AI Generalists to join a highly specialized evaluation project focused on testing and assessing the performance of a cutting-edge generative audio model. Your work will play an important role in identifying performance issues and providing feedback that can help improve the model.
What You’ll Be Doing
You will evaluate AI-generated audio for short video and text-to-audio tasks, following detailed project guidelines. Your main responsibilities will include:
Audio Quality & Naturalness: Assess speech, background music, and sound effects for clarity, quality, and naturalness.
Audio-Video Alignment: Evaluate synchronization between the generated audio and video, including lip-sync and timing.
Caption Compliance: Check whether the generated audio accurately follows the provided text captions and task requirements.
Voice Quality: Evaluate whether generated voices sound natural and, where applicable, match the reference audio.
Evaluation & Feedback: Assign accurate scores and identify issues according to the provided evaluation guidelines.
What We’re Looking For
Native-level fluency in Polish
Strong attention to detail and excellent listening skills
Ability to follow detailed evaluation guidelines consistently
Good understanding of spoken language, audio quality, and context
Reliable equipment — high-quality headphones are required
Ability to complete the evaluation test within 48 hours of receiving the assignment
Qualification Process
Application
(You are here!)
Screening Survey
Language Knowledge Assessments
Target Language
English
RWS Vendor Onboarding
Internal Testing
Project-specific testing will be required, such as TTS Evaluation, Audio Evaluation, or Transcription Testing.
#LI-CAN17
Vendor Type
When applying, please select the option that best describes your working status.
Are you a Freelancer or Private Individual?
A Freelancer is someone who has a business license and may have a VAT number or EIN for tax purposes. A VAT (Value Added Tax) number is a unique identifier assigned to a registered business in many countries; an EIN (Employer Identification Number) is a similar identifier used in the US. A Private Individual does not have a business license. If you aren’t sure, you are probably a private individual.
RWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics.
Location: Stockholm; Borås; Eskilstuna; Gävle; Halmstad; Helsingborg; Jönköping; Lund; Umeå; Malmö; Norrköping; Södertälje; Uppsala; Västerås; Örebro
Workplace: remote
We are looking for Generative Audio Evaluation Specialists! A great entry point into ongoing work within one of our most active AI markets!
Job Type: Freelance
Location: Remote (Sweden)
Work Schedule: Part-time - 10+ hours per week. Flexible - work whenever you want!
Rate: 19USD/hour
Help Shape the Future of AI
We’re currently hiring AI Generalists to join a highly specialized evaluation project focused on testing and assessing the performance of a cutting-edge generative audio model. Your work will play an important role in identifying performance issues and providing feedback that can help improve the model.
What You’ll Be Doing
You will evaluate AI-generated audio for short video and text-to-audio tasks, following detailed project guidelines. Your main responsibilities will include:
Audio Quality & Naturalness: Assess speech, background music, and sound effects for clarity, quality, and naturalness.
Audio-Video Alignment: Evaluate synchronization between the generated audio and video, including lip-sync and timing.
Caption Compliance: Check whether the generated audio accurately follows the provided text captions and task requirements.
Voice Quality: Evaluate whether generated voices sound natural and, where applicable, match the reference audio.
Evaluation & Feedback: Assign accurate scores and identify issues according to the provided evaluation guidelines.
What We’re Looking For
Native-level fluency in Swedish
Strong attention to detail and excellent listening skills
Ability to follow detailed evaluation guidelines consistently
Good understanding of spoken language, audio quality, and context
Reliable equipment — high-quality headphones are required
Ability to complete the evaluation test within 48 hours of receiving the assignment
Qualification Process
Application
(You are here!)
Screening Survey
Language Knowledge Assessments
Target Language
English
RWS Vendor Onboarding
Internal Testing
Project-specific testing will be required, such as TTS Evaluation, Audio Evaluation, or Transcription Testing.
#LI-CAN17
Vendor Type
When applying, please select the option that best describes your working status.
Are you a Freelancer or Private Individual?
A Freelancer is someone who has a business license and may have a VAT number or EIN for tax purposes. A VAT (Value Added Tax) number is a unique identifier assigned to a registered business in many countries; an EIN (Employer Identification Number) is a similar identifier used in the US. A Private Individual does not have a business license. If you aren’t sure, you are probably a private individual.
RWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics.
Location: London; New York; San Francisco; Dubai
Workplace: Remote
VC PARTNERSHIPS & BUSINESS DEVELOPMENT MANAGER
Pragmatike is on a mission to help early-stage startups and scaleups win the talent war and build exceptional tech teams.
ABOUT THE ROLE
We're looking for a VC Partnerships & Business Development Manager to build Pragmatike's relationships with venture capital firms and create a new growth channel for our business.
Your mission will be to build relationships with VCs and position Pragmatike as a trusted talent partner for their portfolio companies.
You'll identify and engage VC partners, principals, platform teams, and operating partners, introduce them to Pragmatike's talent solutions, and develop partnerships that can lead to opportunities across their portfolio.
This is a highly entrepreneurial, relationship-driven role. You'll be building this channel from the ground up, with significant ownership over strategy, outreach, partnerships, and revenue generation.
WHY THIS ROLE IS DIFFERENT
- Build a VC channel from zero to one: Define our strategy for identifying, approaching, and partnering with venture capital firms.
- Sell at the fund level: Build relationships with VCs that can open doors to multiple portfolio companies rather than selling one company at a time.
- Create strategic partnerships: Position Pragmatike as a trusted resource VCs can recommend when their portfolio companies need exceptional technical and product talent.
- High ownership: Own the full process from identifying target funds and opening conversations to developing partnerships and generating portfolio opportunities.
- Work directly with founders: Collaborate closely with Pragmatike's leadership team and help shape our broader go-to-market strategy.
- Build a powerful network: Develop relationships across the global VC, startup, and technology ecosystem.
YOU’RE A FIT IF YOU…
- Have 3+ years of experience in business development, partnerships, sales, recruiting, or a similar commercial role.
- Have experience working with VCs, venture-backed startups, founders, or the broader startup ecosystem.
- Understand how venture capital firms operate and how they support their portfolio companies.
- Are highly comfortable reaching out to and building relationships with senior investors, partners, and executives.
- Have a strong commercial mindset and know how to turn relationships into meaningful business opportunities.
- Are entrepreneurial, proactive, and comfortable building something from scratch.
- Communicate exceptionally well in English, both verbally and in writing.
- Are self-motivated and comfortable working remotely with significant autonomy.
- Have a genuine interest in venture capital, startups, technology, and talent.
NICE TO HAVE
- Existing relationships with VC funds, accelerators, or startup ecosystem organizations.
- Experience selling recruitment, staffing, talent, HRTech, or B2B professional services.
- Previous experience working in VC, portfolio support, startup platforms, or founder-facing roles.
- A strong personal network within the startup and investment ecosystem.
- Experience with tools such as LinkedIn Sales Navigator, Apollo, HubSpot, Clay, or similar platforms.
- Experience working with early-stage technology companies.
COMPENSATION & BENEFITS
- Flexible freelance contract with competitive performance-based compensation.
- Significant ownership over the development of Pragmatike's VC partnership channel.
- Fully remote work environment with flexible hours.
- Direct collaboration with Pragmatike's founders.
- Opportunity to build a high-value network across the global venture capital and startup ecosystem.
- High-growth environment with significant career progression opportunities.
Ready to build Pragmatike's VC partnership network and help the world's best startups build exceptional teams? Apply now and help us build this channel from the ground up. 🍜🏴☠️
УдалённоBrazil (Remote)
УдалённоSwitzerland (Remote)
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.