Location: California; Sunnyvale, CA; San Francisco, CA; Seattle, WA; Redmond, Washington; Burlingame, CA; New York City Metropolitan Area; Los Angeles, CA; Washington, D.C.; Boston, MA
Workplace: onsite
Overview
Welo Data is looking for sharp, curious, and detail-oriented individuals to join our team as Data Labeling Associate.
This is not a traditional annotation role.
You’ll be working directly with cutting-edge AI systems — evaluating outputs, identifying gaps, and helping improve how these systems behave in real-world scenarios. The work sits at the intersection of data quality, model evaluation, and human judgment, where your ability to think critically matters just as much as following guidelines.
We’re looking for people who are naturally curious about AI, comfortable forming opinions, and confident in contributing to conversations with teammates, leads, and stakeholders.
Project Details
Job Title: Data Labeling Associate
Hiring in: Onsite (Bay Area, Seattle, NYC, or client-dependent)
Hours: Full-time, 40 hours per week
Employment Type: W2 Full-Time Employee
Work Authorization: Must be authorized to work in the U.S. (no visa sponsorship)
Pay Rate: $34/hour
Important: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston, Austin. Please only apply if you meet this location requirement.
What You’ll Do
Evaluate AI model outputs and provide structured, high-quality feedback
Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes
Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios
Contribute to improving evaluation frameworks, not just executing them
Identify trends in model performance and communicate insights clearly
Participate in team discussions, calibrations, and stakeholder syncs
Partner with leads and cross-functional teams to refine quality standards
Document findings in a clear, concise, and actionable way
What We’re Looking For
Native-level French proficiency
and a
university degree
(Bachelor’s or higher).
B2 or superior level of English.
1–2 years of professional writing experience with strong, structured writing skills
Ability to apply complex writing rules and guidelines consistently
Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
Strong critical thinking and attention to detail
Ability to make sound judgment calls in ambiguous situations
Naturally curious about AI, technology, and how systems behave
Comfortable speaking up, asking questions, and contributing ideas
Strong written and verbal communication skills
Ability to stay consistent while working with evolving guidelines
Experience in data quality, QA, annotation, or analysis is helpful — but not required
Benefits
Paid Vacation: 6 days
Paid Company Holidays: 2 days (Memorial Day and Labor Day)
Paid Sick Leave: accrued per applicable state law and company policy
Medical, Dental, and Vision Insurance (eligibility applies)
Health Savings Account (HSA)
401(k) Retirement Plan
Employee Assistance Program
Additional voluntary benefits (life, accident, critical illness, etc.)
Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
Unique Campus Features: Some locations include roof-top nature parks
Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.
Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.
To know more details (Click here)
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire. In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them. www.welocalize.com
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.
Why This Role
This is an opportunity to move beyond traditional data work and play a direct role in how AI systems are evaluated and improved. The work is fast-moving, collaborative, and increasingly central to how modern AI systems are built and deployed.
ОфисCalifornia; Sunnyvale, CA; San Francisco, CA; Seattle, WA; Redmond, Washington; Burlingame, CA; New York City Metropolitan Area; Los Angeles, CA; Washington, D.C.; Boston, MA; To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston, Austin
Location: China (Remote); Taiwan (Remote)
Workplace: Remote
ABOUT THE OPPORTUNITY
We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches.
Note this is a remote, freelance opportunity
WHAT YOU’LL DELIVER
- Task Engineering: Evaluating Coding Agents.
- Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling.
- Prompting & Translation: finding failure points where AI does not work, in your native language
- Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary).
- Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus).
- Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.
QUALIFICATIONS
- Experience: 1+ years of industry experience in software engineering.
- Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
- Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency.
- Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing.
- Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
- Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including:
- Encoding/decoding robustness and Unicode normalization.
- Locale-dependent conventions (collation, casing, non-Gregorian dates).
- Text I/O, toolchain interoperability, and safe string operations.
- (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts.
WHY COLLABORATE WITH LILT?
- Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging.
- Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices.
- Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate.
- Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together.
- Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains.
- Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows.
WHAT TO CONSIDER BEFORE APPLYING
- Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed.
- Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit.
- Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging.
HOW TO JOIN OUR EXPERT COMMUNITY
1 - Submit your application including an updated copy of your CV in English
2 - Next, complete a GenAI assessment to evaluate your skills
3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects.
AI is changing how the world communicates — and LILT is leading that transformation.
LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.
Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
Location: USA (Remote); Washington (Remote); New York, NY (Remote); Massachusetts (Remote); Indiana (Remote)
Workplace: Remote
The Production Team at LILT:
LILT’s Production Team is a global workforce, operating across four continents. We are passionate about localization and making information accessible to all. The Team spans project management, program management, quality, and talent management, working with some of the world’s largest organizations.
Working in LILT’s Production Team you will have access to leading tools, collaborative teammates, and opportunities to make a real impact.
What You’ll Do:
The Project Manager, Production ensures successful production execution across a portfolio of Life Science accounts. This role is a fundamental component of the production life cycle, ensuring projects are delivered on-time, on budget and to accepted quality standards. The Project Manager, Production will have customer facing production duties as well as internal responsibility to delegate project coordination and administrative work to teams of Production Coordinators.
Key Responsibilities:
- Able to complete project management tasks autonomously
- Responsible for maintaining resources, core teams and pipeline to support project management work
- Responsiveness to internal and external comms within pre-defined SLAs
- Risk analysis to identify risks, potential issues, plan to and mitigate them
- Able to define and delegate admin work to PCs Interns
- Able to take responsibility for end to end project deliverables in accordance with SLAs
- Effectively balances and manages priorities across a variety of task types and customers
- Establishes deadlines /ensures deadlines are feasible and completes tasks by said deadlines
- Escalates issues or problems to manager in an effective manner, along with proposed solutions
- Asks pertinent questions to ensure full comprehension of the task in hand; Strictly follows Production SOPs and best practices. Responsible for CM, Quality and OTD KPIs.
- Manage the end to end project management workflow
- Ensure all projects are delivered on time as per customer SLA
- Manage quality at project level - including Review, Verification, QA, LQE
- Responds quickly and efficiently to internal and external stakeholders
- Ensure all system admin, including data entry, is accurate
- Process and approves invoicing and payments
- Perform file analysis and engages with Solutions team for support on file types
- Creates and monitors linguistic assets (TM, Style Guides, reference material)
- Demonstrates a deep understanding of all production workflows and processes related to their accounts
- Utilize systems and tools released by Production Enablement
- Train supporting resources on key production processes and methodology
- Develop and maintain process documentation related to their task load and the tasks delegated to other resources.
- Consistently follow correct protocols for tasks and accounts.
- Monitor and enforce adherence to correct production procedures
- Provides insight to Strategist into revenue forecasts based on production volume
- Manage quality complaints and feedback received from stakeholders
- Raise Customer Support tickets for 100% of production blockers (Jira)
- Identifies resource requirements for production work
- Performs self-sourcing in our existing vendor database and enters sourcing requests when new vendors are needed
- Completes ongoing risk assessment and mitigation for all production areas.
- Manage linguist communication for all projects
Skills and Experience:
- A Bachelor’s degree, or equivalent; Master’s degree preferred
- 2+ years of proven project management experience in clinical trials localization preferred
- Excellent client-facing and internal communication skills
- Solid organizational skills including meticulous attention to detail and multitasking skills
- Able to meet deadlines and work under pressure
AI is changing how the world communicates — and LILT is leading that transformation.
LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.
Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
Location: Remote - United States
Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.
Scope of the Role:
At Innodata, we’re partnering with the world’s leading technology companies to build the future of generative AI and large language models (LLMs). We’re on the lookout for smart, savvy, and curious Generative AI Specialist to join our global contributor community as part of our Subject Matter Expert (SME) on Demand program.
This is not a traditional full-time role. It’s a part-time, remote, flexible, project-specific opportunity designed for those who want to make a real impact—on their schedule. Whether you're a writer, linguist, educator, researcher, or just deeply passionate about language and logic, this role lets you contribute to cutting-edge AI development while maintaining control over your time.
You’ll be helping LLMs learn the intricacies of language and reasoning—not just how to write, but how to think. If you’ve ever dreamed of shaping the intelligence behind tomorrow’s technology, this is your chance.
This is more than just a gig—it’s a rare chance to help shape the future of AI from anywhere in the world, on your own terms.
What You’ll Own:
Rating/assessing the performance of AI models or algorithms based on their output or behavior through a set of evaluative questions.
Labeling elements of a piece of content rather than the content as a whole.
Assigning predefined categories or labels to items.
Evaluating the perceived quality and/or appropriateness of content
Generating labels to advance understanding of a concept, trend etc.
Creation of additional training data for machine learning models by applying transformations to the original data, such as modifying images (rotation, flipping, cropping), generating new text (paraphrasing, summarization), or altering audio/video signals (speed modification, pitch shifting) to reduce overfitting and increase dataset diversity.
Reviewing data and identifying whether or not a product feature works as intended based on the project's guidelines.
Labeling model outputs to identify if a piece of content is or isn't something. Examples: identify clickbait; identifying gaming videos; identifying branded content.
Ordering or ranking items based on a set of preferences or criteria.
Creating prompts or questions that will be used to generate responses from a language model or other AI system.
Projects that evaluate the relevance of content based on a relevancy scale (1-3, 1-5, etc.).
Generating responses to prompts or questions using a language model or other AI system.
Rewriting existing text while preserving the original meaning, often to improve clarity or style and adherence to guidelines.
Producing concise summaries of longer pieces of text or data.
Converting spoken language or audio content into written text.
Converting text or spoken language from one language to another.
Gathering and compiling various forms of data to be used for training, evaluating, or fine-tuning the AI models. This may include text, images, videos, audio files, or other types of digital content.
You’ll Thrive in This Role If You Have:
A Bachelor’s degree or higher in a
humanities specialization
is required. Advanced degrees are strongly preferred (Master’s or PhD)
Professional or Expert level proficiency (C1/C2) in English
The expected hourly salary range for this position is $15 p/hour, based on experience, skills, and qualifications.
Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at
https://consumer.ftc.gov/articles/job-scams.
If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at
verifyjoboffer@innodata.com
and consider reporting it to the FTC at
ReportFraud.ftc.gov
.
Location: Remote - Canada
Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.
Scope of the Role:
At Innodata, we’re partnering with the world’s leading technology companies to build the future of generative AI and large language models (LLMs). We’re on the lookout for smart, savvy, and curious Generative AI Specialist to join our global contributor community as part of our Subject Matter Expert (SME) on Demand program.
This is not a traditional full-time role. It’s a part-time, remote, flexible, project-specific opportunity designed for those who want to make a real impact—on their schedule. Whether you're a writer, linguist, educator, researcher, or just deeply passionate about language and logic, this role lets you contribute to cutting-edge AI development while maintaining control over your time.
You’ll be helping LLMs learn the intricacies of language and reasoning—not just how to write, but how to think. If you’ve ever dreamed of shaping the intelligence behind tomorrow’s technology, this is your chance.
This is more than just a gig—it’s a rare chance to help shape the future of AI from anywhere in the world, on your own terms.
What You’ll Own:
Rating/assessing the performance of AI models or algorithms based on their output or behavior through a set of evaluative questions.
Labeling elements of a piece of content rather than the content as a whole.
Assigning predefined categories or labels to items.
Evaluating the perceived quality and/or appropriateness of content
Generating labels to advance understanding of a concept, trend etc.
Creation of additional training data for machine learning models by applying transformations to the original data, such as modifying images (rotation, flipping, cropping), generating new text (paraphrasing, summarization), or altering audio/video signals (speed modification, pitch shifting) to reduce overfitting and increase dataset diversity.
Reviewing data and identifying whether or not a product feature works as intended based on the project's guidelines.
Labeling model outputs to identify if a piece of content is or isn't something. Examples: identify clickbait; identifying gaming videos; identifying branded content.
Ordering or ranking items based on a set of preferences or criteria.
Creating prompts or questions that will be used to generate responses from a language model or other AI system.
Projects that evaluate the relevance of content based on a relevancy scale (1-3, 1-5, etc.).
Generating responses to prompts or questions using a language model or other AI system.
Rewriting existing text while preserving the original meaning, often to improve clarity or style and adherence to guidelines.
Producing concise summaries of longer pieces of text or data.
Converting spoken language or audio content into written text.
Converting text or spoken language from one language to another.
Gathering and compiling various forms of data to be used for training, evaluating, or fine-tuning the AI models. This may include text, images, videos, audio files, or other types of digital content.
You’ll Thrive in This Role If You Have:
A Bachelor’s degree or higher in a humanities specialization is required. Advanced degrees are strongly preferred (Master’s or PhD)
Professional or Expert level proficiency (C1/C2) in English
The expected hourly salary range for this position is $21 CAD p/hour, based on experience, skills, and qualifications.
Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at
https://consumer.ftc.gov/articles/job-scams.
If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at
verifyjoboffer@innodata.com
and consider reporting it to the FTC at
ReportFraud.ftc.gov
.
Location: Remote
Workplace: remote
About Welo Data
Welo Data, a Welo Global brand, is the multilingual data and evaluation partner for foundation labs and enterprises deploying GenAI systems globally. They deliver the human judgment, data infrastructure, and evaluation systems that ensure AI models perform reliably across languages, cultures, and real-world contexts, at every stage from training through deployment. Its global network of 500,000+ vetted experts spans 300+ languages and locales, enabling high-quality multilingual data creation and structured model evaluation across the full spectrum of modern AI applications — from large language models and voice and speech systems to agentic workflows and robotics and embodied AI. This breadth of linguistic, cultural, and domain expertise enables Welo Data to address critical AI development challenges, including safety, bias, inclusivity, and cross-lingual reliability. A unified global operating model, led by specialized program and quality experts and grounded in assessment-driven talent selection, localized rubrics, and continuous calibration, ensures consistent performance across languages, domains, and modalities. Underpinning all of this is NIMO™ (Network Identity Management and Operations), Welo Data's proprietary identity and fraud-prevention framework. Built to maintain data integrity and workforce trust across a global contributor base, NIMO combines advanced verification, continuous monitoring, and structured QA to ensure every dataset is accurate, traceable, and culturally grounded. welodata.ai
Welo Data is looking for a Content Operations Specialist (Digital Books Content) to support ongoing content curation, metadata quality, and platform integrity initiatives.
In this role, you will be responsible for executing daily and advanced curation tasks across written and audio content, identifying and reporting issues, and ensuring high-quality standards in alignment with client guidelines.
Project Details:
Type of Employment: W-2 employee (eligible for benefits based on hours worked)
Project Duration: 12 Months (Possible Extension)
Working Hours / Schedule: Monday to Friday, 9:00 am – 5:30 pm PST (40 hours per week)
Location: Remote in the US
Pay rate: $23/ hour
The successful candidate must have a valid work authorization for the United States. Welocalize does not provide visa sponsorship for this role.
Key Responsibilities
Execute and optimize daily and advanced content curation tasks across written publications and audio content.
Write and report relevant bugs and errors using best practices through internal database systems.
Manage escalations related to metadata, content integrity, and platform quality.
Prioritize tasks and issues quickly and efficiently.
Balance workloads across a distributed team to ensure coverage.
Develop and maintain standard operating procedures (SOPs), workflow guides, and training materials.
Identify process gaps and implement improvements to increase efficiency and reduce error rates.
Adhere to project-specific quality standards as defined by client guidelines.
Complete assigned tasks accurately and within established timelines.
Requirements
Ability to work from home in a secure environment.
Native-level or fully bilingual fluency (spoken and written) in
Portuguese and English
.
Strong native-language skills and cultural awareness of the relevant country/region.
Highly organized with strong attention to detail and commitment to quality.
Proficiency with Microsoft Office applications (Outlook, Word, Excel, PowerPoint).
Ability to navigate networks and websites using different browsers.
Willingness to work with content that may be sensitive or offensive in nature.
Key Competencies
Strong company and industry awareness.
Excellent problem-solving skills with the ability to identify optimal solutions.
Strong time management and prioritization skills.
Familiarity with a
Plan–Do–Check–Act
approach to tasks and workflows.
High sense of ownership and accountability for deliverables.
Self-motivated and comfortable handling repetitive tasks.
Tech-savvy, with the ability to quickly learn and adapt to new tools and systems.
If you are detail-oriented, quality-driven, and passionate about digital content operations, we encourage you to apply.
Join Welo Data and be part of a global team supporting high-impact digital content initiatives while working in a collaborative and fast-paced environment.
Location: Barcelona, Spain; Romania; Thessaloniki, Greece; Italy
Workplace: remote
About Welo Life Sciences
Welo Life Sciences, a Welo Global brand, is a specialized language and technology partner serving pharmaceutical, CRO, and medical device organizations operating in regulated global markets. We deliver regulator-ready translation, linguistic validation, and localization solutions that support clinical trials, pharmacovigilance, regulatory affairs, labeling, and global commercialization. Our approach combines subject matter expertise with ISO-certified quality processes and technology-enabled workflows designed to integrate seamlessly into life sciences operations. With extensive experience supporting global product development and post-market requirements, Welo Life Sciences helps organizations accelerate timelines, protect data integrity, and maintain compliance across languages and regions. All solutions are delivered within a secure, audit-ready framework supported by seven ISO certifications. welolifesciences.com
Overview
The Quality Manager is the squad team member on a squad (s) responsible for supplier alignment and supplier performance on accounts owned by that squad. Performance includes, but is not limited to, on-time delivery, adherence to all client and project specific requirements, and defect-free deliverables. The role is managing service delivery quality to the client or managing tasks or initiatives. This role is responsible for engaging with the customer to understand capacity requirements and quality expectations and liaising with Language Services to ensure such requirements can be met. As part of ensuring adequate performance, the Quality Manager will monitor customer Objectives & Key Results (OKRs) and take necessary actions to ensure quality and on-time delivery targets are met.
Main Duties
Strategic Alignment: Partner with Engagement Managers to ensure supplier alignment and coordinate with the Language Services Team on resource recommendations and capacity planning.
Client Relationship Management: Serve as the primary point of contact for language quality, leading client conversations, managing documentation, and presenting regular quality reports.
Performance Monitoring: Track supplier KPIs—including OTD, task acceptance, and linguistic accuracy—flagging and escalating any performance that falls beneath defined client thresholds.
Quality Framework & Asset Management: Design and maintain quality frameworks, ensuring all language assets (glossaries, style guides, and TMs) are updated and optimized.
Corrective Action & Escalation: Act as the escalation point for PMs on missed deliverables; lead Root Cause Analysis (RCA) and oversee Quality Improvement Plans (QIP) or CAPAs in collaboration with Language Services.
SLA Compliance: Execute regular quality measuring and Content Type Analysis to ensure all internal and client-facing LQA SLAs are consistently met.
Process Improvement: Support the development of new internal and customer initiatives by assessing and optimizing current processes to drive efficiency.
Experience
Industry Expertise: Proven track record in Localization Vendor, Language, or Quality Management within fast-paced, client-centric environments.
Experience in CRO-Pharma or Medical Devices would be a plus.
Quality Methodology: Deep understanding of quality principles and practices; experience with Agile or Lean Six Sigma methodologies is preferred.
Technical Proficiency: Expert knowledge of Translation Management Systems (TMS), TM tools, and MTPE workflows, with a keen interest in emerging industry trends.
Data-Driven Problem Solving: Strong data literacy with the ability to leverage analytics for decision-making, risk mitigation, and proactive process improvement.
Communication & Influence: Exceptional verbal and written communication skills in English (multilingualism preferred) with the ability to present structured arguments and influence diverse stakeholders.
Operational Agility: High capacity to manage and prioritize multiple time-sensitive projects independently or as part of a team, while maintaining accountability for quality.
Education: Master’s degree or equivalent professional experience.
Leadership & People Management: Full-cycle supervisory experience in accordance with organizational policy, including hiring, training, and performance management for internal teams and external resources.
Key Competencies
Is a strong listener and effective collaborator.
Results-oriented and understands the importance of Objectives & Key Results (OKRs)
Actively drives performance and delivers results.
Proactively develops clear solutions to complex problems
This role is for you if:
You have experience with quality management in the translation/localization industry (in-house or freelance)
You have worked with Life Sciences localization workflows
Please note that only CVs in English will be considered
Job Reference: #LI-JC1
Location: Argentina (Remote); Global | Remote; Mexico (Remote); India (Remote)
Workplace: Remote
Key Responsibilities:
1. End-to-End Program Delivery & SLA Management
- Manage the end to end project management workflow.
- Able to complete project management tasks autonomously.
- Able to take responsibility for end to end project deliverables in accordance with SLAs.
- Ensure all projects are delivered on time as per customer SLA.
- Establishes deadlines /ensures deadlines are feasible and completes tasks by said deadlines.
- Effectively balances and manages priorities across a variety of task types and customers.
- Responsiveness to internal and external comms within pre-defined SLAs.
- Responds quickly and efficiently to internal and external stakeholders.
2. Resource Strategy & Team Leadership
- Responsible for maintaining resources, core teams and pipeline to support project management work.
- Identifies resource requirements for production work.
- Performs self-sourcing in our existing vendor database and enters sourcing requests when new vendors are needed.
- Manage linguist communication for all projects.
- Able to define and delegate admin work to PCs Interns.
- Train supporting resources on key production processes and methodology.
3. Quality, Risk, & Financial Assurance
- Responsible for CM, Quality and OTD KPIs.
- Manage quality at project level - including Review, Verification, QA, LQE.
- Manage quality complaints and feedback received from stakeholders.
- Risk analysis to identify risks, potential issues, plan to and mitigate them.
- Completes ongoing risk assessment and mitigation for all production areas.
- Escalates issues or problems to manager in an effective manner, along with proposed solutions.
- Raise Customer Support tickets for 100% of production blockers (Jira).
- Process and approves invoicing and payments.
- Provides insight to Strategist into revenue forecasts based on production volume.
4. Technical Execution & Process Governance
- Demonstrates a deep understanding of all production workflows and processes related to their accounts.
- Asks pertinent questions to ensure full comprehension of the task in hand; Strictly follows Production SOPs and best practices.
- Consistently follow correct protocols for tasks and accounts.
- Monitor and enforce adherence to correct production procedures.
- Develop and maintain process documentation related to their task load and the tasks delegated to other resources.
- Utilize systems and tools released by Production Enablement.
- Ensure all system admin, including data entry, is accurate.
- Perform file analysis and engages with Solutions team for support on file types.
- Creates and monitors linguistic assets (TM, Style Guides, reference material).
Skills and Experience:
- A Bachelor’s degree, or equivalent; Master’s degree preferred
- 2+ years of professional experience in a field similar or related to Localization Project Management
- Excellent client-facing and internal communication skills
- Solid organizational skills including meticulous attention to detail and multitasking skills
- Able to meet deadlines and work under pressure
AI is changing how the world communicates — and LILT is leading that transformation.
LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world.
Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise.
Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.
Location: Spain; Romania; Greece; France; Germany; Ireland; United Kingdom
Workplace: remote
About Welocalize
Welocalize, a Welo Global brand, serves localization teams through AI-enabled multilingual content solutions that enable enterprises to operate and scale globally. Welocalize combines AI, automation, and human expertise to support enterprises in more than 300 languages, enabling accurate, culturally aligned, and compliant multilingual content at scale.
Welocalize’s Opal Platform comprises patented technology designed to automate multilingual content and improve workflow performance for enterprises. Opal functions as an agentic system that orchestrates AI, automation, and human expertise to coordinate content workflows across the lifecycle, improving speed, scalability, and operational control for global enterprises. These solutions operate within a secure and compliant environment supported by seven ISO certifications. Welocalize is headquartered in New York with offices worldwide. welocalize.com
ROLE OVERVIEW
We are looking for a Kazakh Localization QA Tester / Proofreader to join a long-term.
As a Linguistic Tester, you’ll help bring high-quality Kazakh content to life and ensure it feels natural, accurate, and polished for end users. Your main focus will be reviewing and refining localized content, making sure it reads smoothly and is free from errors. This includes checking grammar, spelling, punctuation, consistency, formatting, and cultural or contextual accuracy.
You’ll also work hands-on with products by executing test cases, identifying localization bugs, and reporting issues through internal bug-tracking systems. Once fixes are implemented, you’ll help verify that they’ve been resolved correctly. From time to time, you’ll also have the opportunity to translate content from English into Kazakh. In addition, you’ll explore user interfaces to identify localization or functional issues, playing an important role in delivering a seamless and user-friendly experience.
This role is ideal for someone with native-level Kazakh fluency, strong attention to detail, and an interest in quality assurance within digital products. If you’re looking for a role where you can apply both your language expertise and technical skills, this is a great opportunity.
MAIN DUTIES
- Write and report relevant bugs and errors using best practices through the internal database system.
- Ability to understand and prioritize tasks and issues quickly and efficiently.
- Native language skills and cultural awareness of Kazakh and Kazakhstan.
- Good oral and written communication.
- Highly organized with attention to detail and a commitment to quality.
- QA various products by accurately following testing instructions and test cases.
- Discover and report defects (bugs) using client-specific bug-tracking tools.
- Evaluate translations in the context of software, mobile apps, and documentation.
- Be a subject matter expert for linguistic issues in Kazakh (from Kazakhstan ); be able to research and resolve linguistic questions.
- Adhere to project-specific quality standards, trademarks, style guides, and client-preferred checklists and glossaries.
- Troubleshoot basic problems; be able to communicate effectively and escalate testing issues.
- Complete assigned tasks in a quality and timely manner.
IDEAL BACKGROUNDS: Marketing, Journalism, Copy Editing, Proofreading, Writing, Translation, and/or Localization
Job Reference: #LI-JC1
Location: United States
Workplace: remote
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Are you detail-oriented and curious about tech?
Welo Data is building a global network of linguists, language enthusiasts, and culturally aware contributors to shape safer, smarter AI.
By joining our talent community, you'll be first in line for flexible, remote projects in annotation, evaluation, and prompt creation—always on your terms.
Note: This is not an active job opening. By applying, you'll join our global contributor network. When a project aligns with your skills and availability, we'll reach out with all the details, including scope, timeline, and compensation.
What You'll Need
- Native or near-native fluency in English
- Based in: United States
- Comfortable with digital tools
- Detail-oriented and curious
Why Join Us?
🚀 Limitless You – Work when and where you want, with room to grow
🤖 Limitless AI – Contribute to smarter, more inclusive AI
🌎 Be Part of Us – Join a global, supportive community
About our projects:
Welo Data projects vary by scope and complexity, but all play a role in building more accurate, inclusive, and human-centered AI.
Depending on your skills, you might:
📝 Annotate or label text, images, or audio to train AI systems
🔍 Evaluate search results, ads, or chatbot responses for quality and relevance
💬 Create and test prompts to improve large language models (LLMs)
🌍 Ensure content reflects cultural, linguistic, or industry-specific accuracy
Some projects last a few days; others may extend over several weeks. Before each one, you'll receive clear details on tasks, timelines, and compensation, so you can decide what works best for you.
How to Apply?
Click the “Apply” button on our website to fill out a short form and join our talent database. It only takes a few minutes to get started and become part of our growing community.
📬 Questions?
If you have any questions about the process, feel free to contact us at TalentRequests@welocalize.com .
Location: Canada
Workplace: remote
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Are you detail-oriented and curious about tech?
Welo Data is building a global network of linguists, language enthusiasts, and culturally aware contributors to shape safer, smarter AI.
By joining our talent community, you'll be first in line for flexible, remote projects in annotation, evaluation, and prompt creation—always on your terms.
Note: This is not an active job opening. By applying, you'll join our global contributor network. When a project aligns with your skills and availability, we'll reach out with all the details, including scope, timeline, and compensation.
What You'll Need
- Native or near-native fluency in English
- Based in: Canada
- Comfortable with digital tools
- Detail-oriented and curious
Why Join Us?
🚀 Limitless You – Work when and where you want, with room to grow
🤖 Limitless AI – Contribute to smarter, more inclusive AI
🌎 Be Part of Us – Join a global, supportive community
About our projects:
Welo Data projects vary by scope and complexity, but all play a role in building more accurate, inclusive, and human-centered AI.
Depending on your skills, you might:
📝 Annotate or label text, images, or audio to train AI systems
🔍 Evaluate search results, ads, or chatbot responses for quality and relevance
💬 Create and test prompts to improve large language models (LLMs)
🌍 Ensure content reflects cultural, linguistic, or industry-specific accuracy
Some projects last a few days; others may extend over several weeks. Before each one, you'll receive clear details on tasks, timelines, and compensation, so you can decide what works best for you.
How to Apply?
Click the “Apply” button on our website to fill out a short form and join our talent database. It only takes a few minutes to get started and become part of our growing community.
📬 Questions?
If you have any questions about the process, feel free to contact us at TalentRequests@welocalize.com .
Location: India
Workplace: remote
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Are you detail-oriented and curious about tech?
Welo Data is building a global network of linguists, language enthusiasts, and culturally aware contributors to shape safer, smarter AI.
By joining our talent community, you'll be first in line for flexible, remote projects in annotation, evaluation, and prompt creation—always on your terms.
Note: This is not an active job opening. By applying, you'll join our global contributor network. When a project aligns with your skills and availability, we'll reach out with all the details, including scope, timeline, and compensation.
What You'll Need
- Native or near-native fluency in English
- Based in: India
- Comfortable with digital tools
- Detail-oriented and curious
Why Join Us?
🚀 Limitless You – Work when and where you want, with room to grow
🤖 Limitless AI – Contribute to smarter, more inclusive AI
🌎 Be Part of Us – Join a global, supportive community
About our projects:
Welo Data projects vary by scope and complexity, but all play a role in building more accurate, inclusive, and human-centered AI.
Depending on your skills, you might:
📝 Annotate or label text, images, or audio to train AI systems
🔍 Evaluate search results, ads, or chatbot responses for quality and relevance
💬 Create and test prompts to improve large language models (LLMs)
🌍 Ensure content reflects cultural, linguistic, or industry-specific accuracy
Some projects last a few days; others may extend over several weeks. Before each one, you'll receive clear details on tasks, timelines, and compensation, so you can decide what works best for you.
How to Apply?
Click the “Apply” button on our website to fill out a short form and join our talent database. It only takes a few minutes to get started and become part of our growing community.
📬 Questions?
If you have any questions about the process, feel free to contact us at TalentRequests@welocalize.com .
Location: New Zealand
Workplace: remote
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Are you detail-oriented and curious about tech?
Welo Data is building a global network of linguists, language enthusiasts, and culturally aware contributors to shape safer, smarter AI.
By joining our talent community, you'll be first in line for flexible, remote projects in annotation, evaluation, and prompt creation—always on your terms.
Note: This is not an active job opening. By applying, you'll join our global contributor network. When a project aligns with your skills and availability, we'll reach out with all the details, including scope, timeline, and compensation.
What You'll Need
- Native or near-native fluency in English
- Based in: New Zealand
- Comfortable with digital tools
- Detail-oriented and curious
Why Join Us?
🚀 Limitless You – Work when and where you want, with room to grow
🤖 Limitless AI – Contribute to smarter, more inclusive AI
🌎 Be Part of Us – Join a global, supportive community
About our projects:
Welo Data projects vary by scope and complexity, but all play a role in building more accurate, inclusive, and human-centered AI.
Depending on your skills, you might:
📝 Annotate or label text, images, or audio to train AI systems
🔍 Evaluate search results, ads, or chatbot responses for quality and relevance
💬 Create and test prompts to improve large language models (LLMs)
🌍 Ensure content reflects cultural, linguistic, or industry-specific accuracy
Some projects last a few days; others may extend over several weeks. Before each one, you'll receive clear details on tasks, timelines, and compensation, so you can decide what works best for you.
How to Apply?
Click the “Apply” button on our website to fill out a short form and join our talent database. It only takes a few minutes to get started and become part of our growing community.
📬 Questions?
If you have any questions about the process, feel free to contact us at TalentRequests@welocalize.com .
Location: Australia
Workplace: remote
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Are you detail-oriented and curious about tech?
Welo Data is building a global network of linguists, language enthusiasts, and culturally aware contributors to shape safer, smarter AI.
By joining our talent community, you'll be first in line for flexible, remote projects in annotation, evaluation, and prompt creation—always on your terms.
Note: This is not an active job opening. By applying, you'll join our global contributor network. When a project aligns with your skills and availability, we'll reach out with all the details, including scope, timeline, and compensation.
What You'll Need
- Native or near-native fluency in English
- Based in: Australia
- Comfortable with digital tools
- Detail-oriented and curious
Why Join Us?
🚀 Limitless You – Work when and where you want, with room to grow
🤖 Limitless AI – Contribute to smarter, more inclusive AI
🌎 Be Part of Us – Join a global, supportive community
About our projects:
Welo Data projects vary by scope and complexity, but all play a role in building more accurate, inclusive, and human-centered AI.
Depending on your skills, you might:
📝 Annotate or label text, images, or audio to train AI systems
🔍 Evaluate search results, ads, or chatbot responses for quality and relevance
💬 Create and test prompts to improve large language models (LLMs)
🌍 Ensure content reflects cultural, linguistic, or industry-specific accuracy
Some projects last a few days; others may extend over several weeks. Before each one, you'll receive clear details on tasks, timelines, and compensation, so you can decide what works best for you.
How to Apply?
Click the “Apply” button on our website to fill out a short form and join our talent database. It only takes a few minutes to get started and become part of our growing community.
📬 Questions?
If you have any questions about the process, feel free to contact us at TalentRequests@welocalize.com .
Location: Philippines
Workplace: remote
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Are you detail-oriented and curious about tech?
Welo Data is building a global network of linguists, language enthusiasts, and culturally aware contributors to shape safer, smarter AI.
By joining our talent community, you'll be first in line for flexible, remote projects in annotation, evaluation, and prompt creation—always on your terms.
Note: This is not an active job opening. By applying, you'll join our global contributor network. When a project aligns with your skills and availability, we'll reach out with all the details, including scope, timeline, and compensation.
What You'll Need
- Native or near-native fluency in English
- Based in: Philippines
- Comfortable with digital tools
- Detail-oriented and curious
Why Join Us?
🚀 Limitless You – Work when and where you want, with room to grow
🤖 Limitless AI – Contribute to smarter, more inclusive AI
🌎 Be Part of Us – Join a global, supportive community
About our projects:
Welo Data projects vary by scope and complexity, but all play a role in building more accurate, inclusive, and human-centered AI.
Depending on your skills, you might:
📝 Annotate or label text, images, or audio to train AI systems
🔍 Evaluate search results, ads, or chatbot responses for quality and relevance
💬 Create and test prompts to improve large language models (LLMs)
🌍 Ensure content reflects cultural, linguistic, or industry-specific accuracy
Some projects last a few days; others may extend over several weeks. Before each one, you'll receive clear details on tasks, timelines, and compensation, so you can decide what works best for you.
How to Apply?
Click the “Apply” button on our website to fill out a short form and join our talent database. It only takes a few minutes to get started and become part of our growing community.
📬 Questions?
If you have any questions about the process, feel free to contact us at TalentRequests@welocalize.com .
Location: Porto, Portugal
Workplace: remote
We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to leverage prompt engineering techniques to maximize model performance.
Responsibilities:
Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
Run and supervise Automated Prompt Optimization (APO) tool, review the outputs, and flag when the APO reaches deadlocks or plateaus.
Manually draft, test, and refine prompts to navigate complex template architectures, overcome anti-patterns, and handle edge cases where tooling is lacking or broken. Solve edge-case scenarios by designing and refining manual prompts.
Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked.
Run prompt versions against established gold data to continuously measure autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.
Draft technical launch readiness justifications (Launch Certification Documentation) for final.
Requirement:
Language Skills
:
Native fluency in Portuguese and fluent in English.
Location:
Must be based in Portugal.
Education
:
Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
Prompt Engineering & AI Expertise
:
At least 4 years' experience as Prompt Engineer. Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning.
Data Analysis
:
Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
Technical Agility
:
Ability to quickly learn and master proprietary tools with minimal supervision.
Communication
:
Excellent verbal and written communication skills.
Optional / Preferred Skills:
Familiarity with enterprise-grade LLM interfaces like the Goose API.
Experience in AI model evaluation, data science, computational linguistics, or software engineering.
Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows.
Linguistic expertise, including an understanding of semantics and logic.
Location: Netherlands
Workplace: remote
We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to leverage prompt engineering techniques to maximize model performance.
Responsibilities:
Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
Run and supervise Automated Prompt Optimization (APO) tool, review the outputs, and flag when the APO reaches deadlocks or plateaus.
Manually draft, test, and refine prompts to navigate complex template architectures, overcome anti-patterns, and handle edge cases where tooling is lacking or broken. Solve edge-case scenarios by designing and refining manual prompts.
Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked.
Run prompt versions against established gold data to continuously measure autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.
Draft technical launch readiness justifications (Launch Certification Documentation) for final.
Requirement:
Language Skills
:
Native fluency in Dutch and fluent in English.
Location:
Must be based in Netherlands.
Education
:
Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
Prompt Engineering & AI Expertise
:
At least 4 years' experience as Prompt Engineer. Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning.
Data Analysis
:
Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
Technical Agility
:
Ability to quickly learn and master proprietary tools with minimal supervision.
Communication
:
Excellent verbal and written communication skills.
Optional / Preferred Skills:
Familiarity with enterprise-grade LLM interfaces like the Goose API.
Experience in AI model evaluation, data science, computational linguistics, or software engineering.
Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows.
Linguistic expertise, including an understanding of semantics and logic.
Location: Japan
Workplace: remote
We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to leverage prompt engineering techniques to maximize model performance.
Responsibilities:
Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
Run and supervise Automated Prompt Optimization (APO) tool, review the outputs, and flag when the APO reaches deadlocks or plateaus.
Manually draft, test, and refine prompts to navigate complex template architectures, overcome anti-patterns, and handle edge cases where tooling is lacking or broken. Solve edge-case scenarios by designing and refining manual prompts.
Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked.
Run prompt versions against established gold data to continuously measure autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.
Draft technical launch readiness justifications (Launch Certification Documentation) for final.
Requirement:
Language Skills
:
Native fluency in Japanese and fluent in English.
Location:
Must be based in Japan.
Education
:
Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
Prompt Engineering & AI Expertise
:
At least 4 years' experience as Prompt Engineer. Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning.
Data Analysis
:
Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
Technical Agility
:
Ability to quickly learn and master proprietary tools with minimal supervision.
Communication
:
Excellent verbal and written communication skills.
Optional / Preferred Skills:
Familiarity with enterprise-grade LLM interfaces like the Goose API.
Experience in AI model evaluation, data science, computational linguistics, or software engineering.
Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows.
Linguistic expertise, including an understanding of semantics and logic.
Удалённоsenior
УдалённоChina (Remote); Taiwan (Remote)
УдалённоUSA (Remote); Washington (Remote); New York, NY (Remote); Massachusetts (Remote); Indiana (Remote)
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.