Вакансии

Location: Barcelona, Spain; Tokyo, Japan; Portland, OR Workplace: onsite About Welocalize  Welocalize, a Welo Global brand, serves localization teams through AI-enabled multilingual content solutions that enable enterprises to operate and scale globally. Welocalize combines AI, automation, and human expertise to support enterprises in more than 300 languages, enabling accurate, culturally aligned, and compliant multilingual content at scale.   Welocalize’s Opal Platform comprises patented technology designed to automate multilingual content and improve workflow performance for enterprises. Opal functions as an agentic system that orchestrates AI, automation, and human expertise to coordinate content workflows across the lifecycle, improving speed, scalability, and operational control for global enterprises. These solutions operate within a secure and compliant environment supported by seven ISO certifications. Welocalize is headquartered in New York with offices worldwide. welocalize.com  ROLE OVERVIEW  Welocalize is looking for a native-level Turkish speaker to join a confidential, large-scale AI and consumer technology programme for a major global technology and communications client.  It's a hands-on, on-site role that combines two things: evaluating a pre-release AI model in your language, and testing how the product actually performs on a client-supplied device — a smartphone and a next-generation smart glass. If you enjoy noticing the detail other people miss, this is work you'll find satisfying.  Welocalize is looking for a native-level Turkish speaker to join a large-scale AI and consumer technology programme.  It's a hands-on, on-site role that combines two things: evaluating a pre-release AI model in your language, and testing how it performs on a real device. You'll be among the first people to see this technology in Turkish, and your judgment shapes how well it works before anyone else uses it.  If you enjoy noticing the detail other people miss, this is work you'll find satisfying.    MAIN RESPONSIBILITIES  Review pre-release AI model output in Turkish and judge it on accuracy, naturalness, appropriateness, and overall quality — would a native speaker really say it this way? This includes fact-checking each response against the source material.

Location: Chiang Mai, Thailand Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands refine their services. Whether visiting boutiques, purchasing online, or returning a product, your voice shapes the future of luxury. Flexibility - each in-store visit takes approximately 20 minutes, giving you the flexibility to complete multiple assignments. Frequent opportunities - perform several missions per month and collaborate with some of the most prestigious brands worldwide. What you will be doing: Choose your assignments - align your missions with your personal preferences and profile. Visit luxury stores or evaluate online - engage with sales associates in the stores or online from the comfort of your home. Observe carefully - check the ambiance, service quality, and overall customer experience. Provide honest feedback - use our platform to share your observations through questionnaires. About CXG At CXG, we connect premium brands with over 80,000 evaluators across 70 countries. With 12 global offices and almost two decades of CX retail expertise, we’re committed to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform, CXG Live . On this platform, you can seamlessly manage missions, certifications, and feedback. Requirements Current customer of premium and luxury brands. Not currently under contract with any retail brands, to ensure impartiality. Punctual, organized, detail-oriented, and reliable. Observant and passionate about customer experience. No prior experience is required; we value honest feedback from genuine customers. Benefits This is a freelance , project-based position Flexible working hours Compensation for Non-Purchase Evaluations: Earn a fee based on mission complexity. Compensation for Purchase-Based Evaluations: Reimbursement for approved items as stated in the mission brief.

Location: Songkhla, Thailand Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands refine their services. Whether visiting boutiques, purchasing online, or returning a product, your voice shapes the future of luxury. Flexibility - each in-store visit takes approximately 20 minutes, giving you the flexibility to complete multiple assignments. Frequent opportunities - perform several missions per month and collaborate with some of the most prestigious brands worldwide. What you will be doing: Choose your assignments - align your missions with your personal preferences and profile. Visit luxury stores or evaluate online - engage with sales associates in the stores or online from the comfort of your home. Observe carefully - check the ambiance, service quality, and overall customer experience. Provide honest feedback - use our platform to share your observations through questionnaires. About CXG At CXG, we connect premium brands with over 80,000 evaluators across 70 countries. With 12 global offices and almost two decades of CX retail expertise, we’re committed to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform, CXG Live . On this platform, you can seamlessly manage missions, certifications, and feedback. Requirements Current customer of premium and luxury brands. Not currently under contract with any retail brands, to ensure impartiality. Punctual, organized, detail-oriented, and reliable. Observant and passionate about customer experience. No prior experience is required; we value honest feedback from genuine customers. Benefits This is a freelance , project-based position Flexible working hours Compensation for Non-Purchase Evaluations: Earn a fee based on mission complexity. Compensation for Purchase-Based Evaluations: Reimbursement for approved items as stated in the mission brief.

Location: Washington, District of Columbia, United States Dexis is a dynamic professional services firm dedicated to partnering with government and community leaders both in the U.S. and internationally to achieve critical social outcomes in a rapidly changing world. At Dexis, you will experience a corporate culture of inclusiveness, respect, fairness, and trust. You will be given the means and mentorship needed to succeed, and your creativity will be rewarded. About the Position Dexis is seeking a Lead Evaluator to provide technical leadership for an anticipated monitoring, evaluation, and data services contract with ILAB. The contract will support performance evaluations, rapid and ad hoc studies, training and technical assistance, data quality assessments, data analysis, visualization, and synthesis across ILAB-funded technical assistance projects and other program areas. The Lead Evaluator will oversee the planning, implementation, quality assurance, and utilization of monitoring, evaluation, and learning assignments. The Lead Evaluator will match specialists to assignment requirements, guide teams, approve technical work, and ensure findings and recommendations are methodologically sound, evidence-based, and useful to decision-makers. This position is contingent upon award. Responsibilities Lead the planning, implementation, and utilization stages of monitoring, evaluation, and learning assignments. Provide technical leadership for interim, final, thematic, rapid, and other performance evaluations. Translate priority questions into appropriate designs , methodologies, data collection plans, and analytical approaches. Lead terms of reference, evaluation plans, instruments, frameworks, reports, briefs, presentations, and other deliverables. Ensure designs and methods fit the questions, available data, context, schedule, and level of effort. Match specialists’ methodological, sectoral, geographic, and language expertise to assignments. Guide and mentor evaluators, analysts, facilitators, data specialists, and other bench personnel. Conduct technical quality reviews and approve work products before submission. Lead or support interviews, site visits, observations, workshops, trainings, and field data collection. Oversee qualitative and quantitative analysis of documentation, indicators, stakeholder input, and other data. Support rapid studies, cross-project analyses, political economy analysis, stakeholder validation, risk analysis, and situational analysis. Design and facilitate trainings , collaborative learning activities, sense-making sessions, and cross-team workshops. Support data quality assessments, indicator development, evaluation planning, adaptive management, and use of findings. Ensure findings and recommendations are accurate , evidence-based, and suited to the intended audience. Adapt approaches based on stakeholder input without expanding beyond approved priority questions. Ensure deliverables meet accessibility, data protection, confidentiality, and PII requirements. Verify any AI-assisted analysis or content before it is included in a deliverable. Qualifications Master’s degree or higher. At least eight years of recent monitoring, evaluation, and learning experience with international development projects in communities and among populations comparable to those served by ILAB projects. Demonstrated experience leading evaluation teams and producing high-quality deliverables. Recent experience, within the past three years, leading evaluation teams virtually and through hybrid arrangements. Technical expertise in program evaluation, performance monitoring, indicator development, data analysis, data use, and learning facilitation. Ability to design trainings , create tools that elicit collective thinking, and lead cross-team learning workshops. Ability to apply portfolio approaches and provide actionable feedback on thematic issues. Experience with at least one of the following: adaptive evaluation; Collaboration, Learning, and Adaptation; rapid evaluation; or use of artificial intelligence in evaluation. Ability to respond to stakeholder input and communicate findings persuasively to support program improvement. Fluency in written and spoken English. Ability to produce high-quality English-language deliverables on schedule. Preferred Qualifications Fluency in one or more languages used where ILAB projects are implemented. Experience evaluating or researching labor rights programs or initiatives. Experience related to child labor, forced labor, human trafficking, worker rights, labor law enforcement, trade and labor commitments, or global supply chains. Experience leading multilingual evaluations involving geographically dispersed stakeholders. Experience obtaining or supporting Institutional Review Board or other ethical research clearance. Experience translating complex evidence into decision briefs, visualizations, presentations, or products for non-technical audiences. Below is the pay range aligned with this position. When developing a range, Dexis evaluates compensation holistically, triangulating between external market research , our budget for the position, and internal equity to arrive at a figure that is fair and competitive. Offers within this range will be based on an individual candidate's qualification, relevant education and experience, skills, performance, and organizational needs. Dexis pay range for this role: $125,000 — $175,000 USD Benefits Dexis offers benefits to support employees’ health, financial security, and well-being. The benefits outlined below are for full-time, US-based positions only. These benefits include: Medical and prescription drug coverage: A choice of three UnitedHealthcare medical plans, with coverage options for employees and eligible dependents. Dental insurance: Dental coverage for employees and eligible dependents, including preventive, basic, major, and orthodontic services, subject to plan limits. Company-paid vision insurance: Vision coverage for employees and eligible dependents, with premiums paid in full by Dexis. Employer-funded health reimbursement arrangement (HRA): Employees who enroll in the Silver HRA medical plan receive an employer-funded HRA to help pay eligible in-network deductible expenses. Company-paid life and disability insurance: Basic life and accidental death and dismemberment (AD&D) insurance, plus short-term and long-term disability coverage. Optional supplemental insurance: Voluntary supplemental life and AD&D insurance options, including life insurance options for eligible dependents. Employee Assistance Program (EAP): Company-paid access to confidential counseling and legal and financial support resources for employees and their families. Health and wellness resources: Virtual care, behavioral health resources, and wellness programs available through the medical plan. Benefits assistance: Personalized support with benefit enrollment, coverage questions, claims, and finding providers through the Employee Care Center. Participation, coverage, and employee contributions are subject to applicable benefit plan terms and eligibility requirements. Dexis is on a mission to help solve today’s most pressing global political, social, and economic challenges and create a world where all people are safe and prosperous. As a Dexis employee, you will be challenged, empowered, and mentored. Our motto is “find a way or make a way” — that’s how Dexis goes “all in.” How will you? If you are passionate about this opportunity, apply now! Only those applicants who meet the above criteria will be contacted for interview. Dexis is an Equal Opportunity Employer, and does not discriminate on the basis of race, color, sex, national origin, religion, pregnancy, disability, age, genetic information, military service, veteran status, ethnicity, citizenship, sexual orientation, gender identity, marital status, childbirth and related medical conditions, including lactation, or any other protected class under applicable law.

Location: New Orleans, United States; Kenner, United States; Marrero, United States; Belle Chasse, United States; Slidell, United States; Luling, United States Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands refine their services. Whether visiting boutiques, purchasing online, or returning a product, your voice shapes the future of luxury. • Flexibility - each in-store visit takes approximately 20 minutes, giving you the flexibility to complete multiple assignments. • Frequent opportunities - perform several missions per month and collaborate with some of the most prestigious brands worldwide. What you will be doing: 1. Choose your assignments - align your missions with your personal preferences and profile. 2. Visit luxury stores or evaluate online - engage with sales associates in the stores or online from the comfort of your home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback - use our platform to share your observations through questionnaires. Perks of the Role: • Collaborate with iconic brands across industries. • Flexible assignments tailored to your interests. • Compensation for your time and input, with the potential for reimbursement on purchases. • A user-friendly platform for managing missions and feedback. How to Join the CXG Community: 1. Register: sign up at live.cxg.com and confirm your email. 2. Complete your profile: fill out your details to 100% and get verified. 3. Get certified: pass the General Certification to access missions. 4. Apply for missions: explore assignments with brands that excite you. 5. Start evaluating: begin making a difference in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations: Reimbursement for approved items as stated in the mission brief. About CXG At CXG, we connect premium brands with over 80,000 evaluators across 70 countries. With 12 global offices and almost two decades of CX retail expertise, we’re committed to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform, CXG Live. On this platform, you can seamlessly manage missions, certifications, and feedback. Requirements Must be 18 years or older (21 years or older in the United States). Current customer of premium and luxury brands. Not currently under contract with any retail brands, to ensure impartiality. Punctual, organized, detail-oriented, and reliable. Observant and passionate about customer experience. No prior experience is required; we value honest feedback from genuine customers.

Location: Remote - Alabama ; Remote - Alaska ; Remote - Arkansas ; Remote - Delaware ; Remote - Florida ; Remote - Georgia ; Remote - Indiana ; Remote - Maryland ; Remote - Massachusetts ; Remote - New Hampshire ; Remote - New Jersey ; Remote - New York ; Remote - South Carolina ; Remote - Texas Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers. Scope of the Role: We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact with two different AI models using the same assigned scenario, carefully compare their responses, and provide structured evaluations based on defined quality criteria. The goal of the evaluation is to create a fair, consistent comparison between models and identify which model delivers the stronger overall conversational experience. What You’ll Own: Review an assigned scenario and roleplay a natural conversation with two different AI models . Conduct comparable conversations with Model A and Model B, keeping the scenario, conversational approach, and overall interaction as consistent as possible. Maintain approximately the same number of conversational turns with each model to support a fair comparison. Record your voice during each interaction and pay close attention to the quality and behavior of the model's responses. Evaluate each model across five defined evaluation dimensions . Identify and categorize relevant error clusters that may occur in the audio or conversation. Compare the performance of Model A and Model B based on the evaluation criteria and your observations. Select the model that demonstrated the stronger overall performance according to the defined evaluation framework. Write a detailed rationale explaining your final preference, referencing specific examples and observations from both conversations. Apply evaluation guidelines consistently across different scenarios and model interactions You’ll Thrive in This Role If You Have Bachelors Degree Strong attention to detail and ability to notice subtle differences in conversational quality. Excellent listening and comprehension skills. Strong written communication skills, particularly the ability to explain observations clearly and objectively. Ability to follow detailed evaluation guidelines consistently. Comfort speaking naturally and roleplaying different conversational scenarios. Ability to compare two interactions fairly without allowing personal preferences to influence the evaluation. Strong critical-thinking and analytical skills. Reliability and consistency when completing structured evaluation tasks. Familiarity with AI assistants, voice-based AI, or conversational systems The expected hourly salary range for this position is $20-$25 p/hour, based on experience, skills, and qualifications. Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams. If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at verifyjoboffer@innodata.com and consider reporting it to the FTC at ReportFraud.ftc.gov .

Location: In Office - San Jose, California Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers. Scope of the Role: We are standing up a dedicated onsite team to evaluate complex, real-world agentic AI workflows for a frontier AI customer. Reviewers work through ambiguous, multi-step scenarios inside isolated test environments, assessing whether AI agents complete tasks safely, respect user intent and consent, and hold up under close scrutiny. The Quality Lead is the person accountable for whether that output is any good. This is a senior individual contributor role. You will not manage the reviewers — that sits with the Engagement Manager — but you set the standard they are held to. You own the audit sample, run calibration, keep the rubric usable as real cases stress it, and train reviewers into the work. You are also the deputy: when the Engagement Manager is out, the engagement runs on you. The quality approach here is not fully defined. We expect you to build it in partnership with the customer's quality leads, or at minimum to take what they have, run it honestly, and come back with specific recommendations for where it falls short. What You’ll Own: Own the quality system for the engagement: audit design, sampling strategy, scoring standards, and how quality gets measured and reported Build that system with the customer's quality leads where none exists, and where one does, operate it and recommend concrete improvements based on what the data shows Re-score a sample of reviewer output as a second pass; identify error patterns rather than isolated mistakes Run calibration sessions: surface disagreement, work it to resolution, and document the reasoning so the outcome holds for future cases Maintain rubric health — flag criteria that are ambiguous, overlapping, or silent on cases the team keeps hitting, and drive revisions through the customer Train and onboard new reviewers, including nesting plans, ramp criteria, and the judgment call on when someone is production-ready Give the Engagement Manager the evidence behind performance conversations: who is drifting, on what, and whether coaching is working Report quality trends to the Engagement Manager and, alongside them, to the customer Deputize for the Engagement Manager on delivery operations during absences Maintain information security, privacy, and facility access practices required by the customer's onsite environment You’ll Thrive in This Role If You Have: Bachelor's degree or equivalent practical experience 4+ years in quality assurance, quality management, or senior review work within annotation, evaluation, trust and safety, or a similarly judgment-intensive domain Direct experience owning a quality function: you designed the audit, not just executed someone else’s Significant experience with AI/ML evaluation work: annotation, red-teaming, RLHF, model or agent evaluation, or trust and safety review Hands-on familiarity with agentic systems: tool use, multi-step task execution, sandboxed environments, and common failure modes Demonstrated ability to run calibration with peers — including holding a position under disagreement and changing it when the argument is better Strong written communication; able to document a scoring standard clearly enough that a reviewer can apply it and an auditor can check it Comfortable in spreadsheets and in a dashboarding tool, with enough Python or SQL to pull and slice your own data (you will not be asked to build interfaces) Experience training or onboarding reviewers into rubric-based work The expected hourly salary range for this position is $75-85 p/hour, based on experience, skills, and qualifications. Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams. If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at verifyjoboffer@innodata.com and consider reporting it to the FTC at ReportFraud.ftc.gov .

Location: In Office - San Jose, California Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers. Scope of the Role: We are standing up a dedicated onsite team to evaluate complex, real-world agentic AI workflows for a frontier AI customer. The Engagement Manager owns this team and this engagement: a group of ten reviewers and one QA lead working inside isolated test environments, assessing whether AI agents complete tasks safely, respect user intent and consent, and hold up under close scrutiny. This is a delivery leadership role with a strong customer-facing component. You are the customer's primary day-to-day contact at the site, accountable for throughput, quality, and turnaround, and responsible for identifying where the engagement should grow next. You will not be scoring trajectories as a daily task, but you need enough technical depth to audit the team's work yourself and defend a scoring decision in a room with the customer's technical leads. What You’ll Own: Own end-to-end delivery for the onsite team: throughput, quality, turnaround, and capacity against committed volumes Manage and develop a team of eleven, including hiring, onboarding, performance management, and retention Serve as the primary onsite point of contact for the customer's program and technical leads; run recurring reviews, report on delivery metrics, and resolve issues before they escalate Audit reviewer output directly — sample trajectories, check rubric application, and assess whether scoring rationale would survive customer review Partner with the QA lead on calibration cycles, quality metrics and evaluation, and rubric refinement; arbitrate disagreements that calibration does not resolve Own the escalation path for safety-relevant and ambiguous findings, including judgment on what reaches the customer and how quickly Identify expansion opportunities within the account: adjacent workstreams, new task types, additional capacity, and scope the work with internal delivery and commercial teams Forecast staffing and cost against the engagement's commercial model, and flag variance early Maintain information security, privacy, and facility access practices required by the customer's onsite environment You’ll Thrive in This Role If You Have: Bachelor's degree or equivalent practical experience 5+ years of professional experience, including direct management of a delivery team of 10–20 people Track record as the customer-facing owner of a services or delivery engagement with an enterprise or technology client, including metrics reporting and issue escalation Significant experience with AI/ML evaluation work: annotation, red-teaming, RLHF, model or agent evaluation, or trust and safety review Ability to read rubric-scored work critically and form an independent view of whether a score is correct Strong written communication; able to produce reporting and escalation memos that a technical customer will accept without rework The expected hourly salary range for this position is $75-85 p/hour, based on experience, skills, and qualifications. Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams. If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at verifyjoboffer@innodata.com and consider reporting it to the FTC at ReportFraud.ftc.gov .

Location: Ubon Ratchathani, Thailand Turn your passion for luxury into a career opportunity! Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands refine their services. Whether visiting boutiques, purchasing online, or returning a product, your voice shapes the future of luxury. Flexibility - each in-store visit takes approximately 20 minutes, giving you the flexibility to complete multiple assignments. Frequent opportunities - perform several missions per month and collaborate with some of the most prestigious brands worldwide. What you will be doing: Choose your assignments - align your missions with your personal preferences and profile. Visit luxury stores or evaluate online - engage with sales associates in the stores or online from the comfort of your home. Observe carefully - check the ambiance, service quality, and overall customer experience. Provide honest feedback - use our platform to share your observations through questionnaires. About CXG At CXG, we connect premium brands with over 80,000 evaluators across 70 countries. With 12 global offices and almost two decades of CX retail expertise, we’re committed to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform, CXG Live . On this platform, you can seamlessly manage missions, certifications, and feedback. Requirements Current customer of premium and luxury brands. Not currently under contract with any retail brands, to ensure impartiality. Punctual, organized, detail-oriented, and reliable. Observant and passionate about customer experience. No prior experience is required; we value honest feedback from genuine customers. Benefits This is a freelance , project-based position Flexible working hours Compensation for Non-Purchase Evaluations: Earn a fee based on mission complexity. Compensation for Purchase-Based Evaluations: Reimbursement for approved items as stated in the mission brief.

Location: Calgary, Canada; Banff, Canada; Anthracite, Canada; Bankhead, Canada; Harvie Heights, Canada; Chestermere, Canada Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands refine their services. Whether visiting boutiques, purchasing online, or returning a product, your voice shapes the future of luxury. • Flexibility - each in-store visit takes approximately 20 minutes, giving you the flexibility to complete multiple assignments. • Frequent opportunities - perform several missions per month and collaborate with some of the most prestigious brands worldwide. What you will be doing: 1. Choose your assignments - align your missions with your personal preferences and profile. 2. Visit luxury stores or evaluate online - engage with sales associates in the stores or online from the comfort of your home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback - use our platform to share your observations through questionnaires. Perks of the Role: • Collaborate with iconic brands across industries. • Flexible assignments tailored to your interests. • Compensation for your time and input, with the potential for reimbursement on purchases. • A user-friendly platform for managing missions and feedback. How to Join the CXG Community: 1. Register: sign up at live.cxg.com and confirm your email. 2. Complete your profile: fill out your details to 100% and get verified. 3. Get certified: pass the General Certification to access missions. 4. Apply for missions: explore assignments with brands that excite you. 5. Start evaluating: begin making a difference in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations: Reimbursement for approved items as stated in the mission brief. About CXG At CXG, we connect premium brands with over 80,000 evaluators across 70 countries. With 12 global offices and almost two decades of CX retail expertise, we’re committed to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform, CXG Live. On this platform, you can seamlessly manage missions, certifications, and feedback. Requirements Must be 18 years or older (21 years or older in the United States). Current customer of premium and luxury brands. Not currently under contract with any retail brands, to ensure impartiality. Punctual, organized, detail-oriented, and reliable. Observant and passionate about customer experience. No prior experience is required; we value honest feedback from genuine customers.

Location: Singapore Are you interested in automobiles and curious about the rapidly evolving Electric Vehicle (EV) industry? If the answer is yes, we are looking for you! As a Freelance Brand Evaluator, you will visit EV showrooms and assess customer experiences, helping brands understand how they engage with visitors and potential customers. Your observations and feedback will help improve customer interactions and showroom experiences across the automotive industry. Flexibility – each showroom visit takes approximately 30 minutes, giving you the flexibility to complete multiple assignments. Frequent opportunities – perform several missions per month and collaborate with some of the most prestigious brands worldwide. What you will be doing: Choose your assignments - align your missions with your personal preferences and profile. Visit EV showrooms – interact with sales consultants and learn about various electric vehicle models and technologies. Observe carefully - evaluate the customer journey, product presentation, staff knowledge, test-drive experience, and overall showroom service. Provide honest feedback - use our platform to share your observations through questionnaires. About CXG At CXG, we connect premium brands with over 80,000 evaluators across 70 countries. With 12 global offices and almost two decades of CX retail expertise, we’re committed to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform, CXG Live. On this platform, you can seamlessly manage missions, certifications, and feedback. Requirements Interested in learning about electric vehicles and the automotive industry. Holds a valid driver's license. New drivers, prospective car buyers, or individuals exploring EV ownership are welcome to apply. Previous vehicle ownership is not required. Enjoy interacting with people and asking questions. Has a keen eye for observing and noting various aspects of the customer experience. Ability to provide objective, honest feedback and complete online questionnaires promptly. Willingness to adapt to different assignment types and evaluation scenarios. Benefits This is a freelance, project-based position Flexible working hours

Location: Phiman, Thailand Are you interested in automobiles and curious about the rapidly evolving Electric Vehicle (EV) industry? If the answer is yes, we are looking for you! As a Freelance Brand Evaluator, you will visit EV showrooms and assess customer experiences, helping brands understand how they engage with visitors and potential customers. Your observations and feedback will help improve customer interactions and showroom experiences across the automotive industry. Flexibility – each showroom visit takes approximately 30 minutes, giving you the flexibility to complete multiple assignments. Frequent opportunities – perform several missions per month and collaborate with some of the most prestigious brands worldwide. What you will be doing: Choose your assignments - align your missions with your personal preferences and profile. Visit EV showrooms – interact with sales consultants and learn about various electric vehicle models and technologies. Observe carefully - evaluate the customer journey, product presentation, staff knowledge, test-drive experience, and overall showroom service. Provide honest feedback - use our platform to share your observations through questionnaires. About CXG At CXG, we connect premium brands with over 80,000 evaluators across 70 countries. With 12 global offices and almost two decades of CX retail expertise, we’re committed to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform, CXG Live. On this platform, you can seamlessly manage missions, certifications, and feedback. Requirements Interested in learning about electric vehicles and the automotive industry. Holds a valid driver's license. New drivers, prospective car buyers, or individuals exploring EV ownership are welcome to apply. Previous vehicle ownership is not required. Enjoy interacting with people and asking questions. Has a keen eye for observing and noting various aspects of the customer experience. Ability to provide objective, honest feedback and complete online questionnaires promptly. Willingness to adapt to different assignment types and evaluation scenarios. Benefits This is a freelance , project-based position Compensation for Non-Purchase Evaluations: Earn a fee based on mission complexity. Compensation for Purchase-Based Evaluations: Reimbursement for approved items as stated in the mission brief.

Location: Москва Наша команда отвечает за **независимую оценку и контроль качества генеративных моделей Банка.** Наша основная задача оценить флагманские генеративные модели Сбера – GigaChat, Kandinsky, GigaCode и PhysicalAI решений. Мы первыми видим, на что способна новая модель и проводим оценку новых возможностей прежде чем она выйдет к пользователям. Мы не просто «проверяем метрики», а: * глубоко разбираемся в подходах команд-разработчиков и в бизнес-процессах, где работают модели * критически рассматриваем архитектурные и методологические решения и предлагаем улучшения * разрабатываем собственные проверки, метрики и бенчмарки и фреймворки для их запуска * проводим оценку логов пользователей для построения наиболее релевантного тестирования Отдельный фокус – R&D деятельность: * создание новых методологий оценки качества * участие в разработке и развитии передовых банковских и российских бенчмарков (MERA, POLLUX и др.) * адаптация передовых мировых бенчмарков под специфику банковских кейсов * и многое другое Эта роль про независимое измерение фундаментального качества модели: не про их обучение – этим занимается отдельная команда Обязанности **Придумывать, как вообще измерить модель** ИИ стремительно развивается в мире и выходят новые модели и их виды, однако не всегда любая новая модель стала лучше предыдущей. Вам будет необходимо создать план по её проверке: что именно измерять, на какой выборке, с чем сравнивать, какая разница вообще будет считаться разницей в реальном качестве. **Отвечать за достоверность измерений** Полученные метрики не всегда отражают только лишь качество модели. Нужно уметь отделять реальный прирост качества от прочих факторов: ловить утечки данных в обучение, отличать дефект модели от дефекта замера, промпта или обвязки и проявлять тот же скепсис к собственной методологии: измеряем ли мы то, что заявили. **Разбираться в причинах ошибок** «Модель ошиблась» – это не вывод, а начало работы. Найденная вами причина той или иной проблемы модели превращается в рекомендацию команде разработки, а рекомендация – в следующую версию модели, которая этой ошибки уже не делает. **Строить автоматическую оценку** Разрабатывать LLM- и VLM-судей под конкретные задачи, разрабатывать с нуля собственные или дорабатывать существующие библиотеки валидации полного цикла и следим за фронтиром AI-исследований в области оценки моделей. **Строить то, чем пользуются другие** Фреймворки оценки, который вы развиваете – общие для команд по всему Банку. Бенчмарки, которые вы делаете, являются достоверной базой реального качества для разработчиков Банка и вне. Требования * **Умение проводить технический и научный ресерч**: находить и критически разбирать актуальные статьи, бенчмарки, модели и реализации; переводить ресерч в конкретные идеи для тестирования и развития внутренних подходов. * **Статистика и дизайн эксперимента:** доверительные интервалы, размер выборки, проверка гипотез, поправки на множественные сравнения * **Понимание современных AI-агентов и агентных систем**: понимать, чем агент отличается от обычного вызова LLM; знать основные компоненты агентной системы: роли, инструменты, контекст, память и оркестрация; * **Понимаете, как устроены генеративным модели изнутри:** трансформер и механизм внимания, диффузии, токенизация, параметры генерации, этапы обучения * **Опыт с генеративными моделями и понимание, как их оценивают:** метрики, бенчмарки, human evaluation, Model-as-a-judge и его ограничения * **Продуктовое мышление**: связывать тестирование с реальными пользовательскими сценариями и понимать, какие ошибки критичны для продукта, понимать влияние результатов на релиз и дальнейшее развитие модели. * **Python на продакшн-уровне:** чистый код по PEP 8, ООП и типовые паттерны проектирования, аннотации типов, привычка к линтерам и статическому анализу (ruff, mypy). Создаете и поддерживаете production-код eval-пайплайнов, читаете и ревьюите чужой. **Будет плюсом:** R&D-опыт или участие в создании бенчмарков; мультимодальные модели (изображения, видео, аудио); evaluation-фреймворки и harness; RAG; работа с асессорами; coding-агенты (Claude Code, Codex, Cursor); опыт работы с оркестрацией: LangGraph, OpenClaw, навыки вайбкодинга и AI-assisted coding **Стек:** Python, pandas, NumPy, PyTorch, HuggingFace (transformers, datasets), vLLM, SGLang, инференс-API, S3, Git, Docker, CI/CD, Linux, Bash. Условия * комфортный современный офис рядом с м. Кутузовская * гибкий формат и удаленной работы, в т.ч. на территории РФ * ежегодный пересмотр зарплаты и годовая премия * корпоративный спортзал и зоны отдыха * более 400 образовательных программ СберУниверситета для профессионального и карьерного развития * расширенный ДМС, льготное страхование для семьи и корпоративная пенсионная программа * гибкий дисконт по ипотечному кредиту, равный 1/3 ключевой ставки ЦБ * подписка Прайм с возможностью совместного использования на трёх близких * скидки на продукты компаний-партнеров * вознаграждение за рекомендацию друзей в команду Сбера.

Location: Nassau, Bahamas Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands refine their services. Whether visiting boutiques, purchasing online, or returning a product, your voice shapes the future of luxury. • Flexibility - each in-store visit takes approximately 20 minutes, giving you the flexibility to complete multiple assignments. • Frequent opportunities - perform several missions per month and collaborate with some of the most prestigious brands worldwide. What you will be doing: 1. Choose your assignments - align your missions with your personal preferences and profile. 2. Visit luxury stores or evaluate online - engage with sales associates in the stores or online from the comfort of your home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback - use our platform to share your observations through questionnaires. Perks of the Role: • Collaborate with iconic brands across industries. • Flexible assignments tailored to your interests. • Compensation for your time and input, with the potential for reimbursement on purchases. • A user-friendly platform for managing missions and feedback. How to Join the CXG Community: 1. Register: sign up at live.cxg.com and confirm your email. 2. Complete your profile: fill out your details to 100% and get verified. 3. Get certified: pass the General Certification to access missions. 4. Apply for missions: explore assignments with brands that excite you. 5. Start evaluating: begin making a difference in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations: Reimbursement for approved items as stated in the mission brief. About CXG At CXG, we connect premium brands with over 80,000 evaluators across 70 countries. With 12 global offices and almost two decades of CX retail expertise, we’re committed to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform, CXG Live. On this platform, you can seamlessly manage missions, certifications, and feedback. Requirements Must be 18 years or older (21 years or older in the United States). Current customer of premium and luxury brands. Not currently under contract with any retail brands, to ensure impartiality. Punctual, organized, detail-oriented, and reliable. Observant and passionate about customer experience. No prior experience is required; we value honest feedback from genuine customers.

Location: Remote - United States Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers. Role Overview We are seeking detail-oriented evaluators to conduct human quality evaluations for an enterprise AI customer support product on Instagram, WhatsApp, and Messenger. You will evaluate and benchmark AI model responses against complex evaluation rubrics using provided business knowledge bases. What You’ll Own: Model Evaluation: Review and score AI-generated customer interactions across Foundational, Experiential, and Operational dimensions (e.g., Action Fidelity, Faithfulness, Hallucination, Compliance, Tone, and Handoff). Intent & Fact Verification: Benchmark both informational (R1) and transactional (R2) customer queries against authoritative business sources (FAQs, product catalogs, SOPs) within the task UI. Quality Assurance: Participate in dual-review processes and daily calibration audits to ensure inter-rater agreement and establish ground-truth performance targets. Performance Targets: Deliver precise evaluation You’ll Thrive in This Role If You Have: Customer Service Background: Prior experience in customer service, call centers, retail, or handling customer communications via email, chat, or phone (highly prioritized). English Proficiency: Exceptional written English skills with a strong command of tone, brand voice, grammar, and nuance. French Proficiency: Exceptional written French skills with a strong command of tone, brand voice, grammar, and nuance. Analytical Precision: Ability to strictly follow multi-tier evaluation guidelines, complex logic trees, and technical rubrics without deviation. Tech Adaptability: Comfort using dedicated web-based tools and labeling interfaces. Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams. If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at verifyjoboffer@innodata.com and consider reporting it to the FTC at ReportFraud.ftc.gov .

Location: Thousand Oaks, United States CXG is a global Customer Experience consulting firm specializing exclusively in serving premium and luxury brands. We partner with premium and luxury brands to transform experiences for meaningful impact. We provide valuable insights and support them in taking actionable steps toward creating seamless customer experiences that deliver more value. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands refine their services. Whether visiting boutiques, purchasing online, or returning a product, your voice shapes the future of luxury. • Flexibility - each in-store visit takes approximately 20 minutes, giving you the flexibility to complete multiple assignments. • Frequent opportunities - perform several missions per month and collaborate with some of the most prestigious brands worldwide. What you will be doing: 1. Choose your assignments - align your missions with your personal preferences and profile. 2. Visit luxury stores or evaluate online - engage with sales associates in the stores or online from the comfort of your home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback - use our platform to share your observations through questionnaires. Perks of the Role: • Collaborate with iconic brands across industries. • Flexible assignments tailored to your interests. • Compensation for your time and input, with the potential for reimbursement on purchases. • A user-friendly platform for managing missions and feedback. How to Join the CXG Community: 1. Register: sign up at live.cxg.com and confirm your email. 2. Complete your profile: fill out your details to 100% and get verified. 3. Get certified: pass the General Certification to access missions. 4. Apply for missions: explore assignments with brands that excite you. 5. Start evaluating: begin making a difference in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations: Reimbursement for approved items as stated in the mission brief. About CXG At CXG, we connect premium brands with over 80,000 evaluators across 70 countries. With 12 global offices and almost two decades of CX retail expertise, we’re committed to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform, CXG Live. On this platform, you can seamlessly manage missions, certifications, and feedback. Requirements Must be 18 years or older (21 years or older in the United States). Current customer of premium and luxury brands. Not currently under contract with any retail brands, to ensure impartiality. Punctual, organized, detail-oriented, and reliable. Observant and passionate about customer experience. No prior experience is required; we value honest feedback from genuine customers.

Location: Charlotte, United States; Pineville, United States; Matthews, United States; Harrisburg, United States; Belmont, United States; Huntersville, United States Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands refine their services. Whether visiting boutiques, purchasing online, or returning a product, your voice shapes the future of luxury. • Flexibility - each in-store visit takes approximately 20 minutes, giving you the flexibility to complete multiple assignments. • Frequent opportunities - perform several missions per month and collaborate with some of the most prestigious brands worldwide. What you will be doing: 1. Choose your assignments - align your missions with your personal preferences and profile. 2. Visit luxury stores or evaluate online - engage with sales associates in the stores or online from the comfort of your home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback - use our platform to share your observations through questionnaires. Perks of the Role: • Collaborate with iconic brands across industries. • Flexible assignments tailored to your interests. • Compensation for your time and input, with the potential for reimbursement on purchases. • A user-friendly platform for managing missions and feedback. How to Join the CXG Community: 1. Register: sign up at live.cxg.com and confirm your email. 2. Complete your profile: fill out your details to 100% and get verified. 3. Get certified: pass the General Certification to access missions. 4. Apply for missions: explore assignments with brands that excite you. 5. Start evaluating: begin making a difference in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations: Reimbursement for approved items as stated in the mission brief. About CXG At CXG, we connect premium brands with over 80,000 evaluators across 70 countries. With 12 global offices and almost two decades of CX retail expertise, we’re committed to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform, CXG Live. On this platform, you can seamlessly manage missions, certifications, and feedback. Requirements Must be 18 years or older (21 years or older in the United States). Current customer of premium and luxury brands. Not currently under contract with any retail brands, to ensure impartiality. Punctual, organized, detail-oriented, and reliable. Observant and passionate about customer experience. No prior experience is required; we value honest feedback from genuine customers.

Location: Scottsdale, United States; Glendale, United States; Chandler, United States; Tucson, United States; Phoenix, United States CXG is a global Customer Experience consulting firm specializing exclusively in serving premium and luxury brands. We partner with premium and luxury brands to transform experiences for meaningful impact. We provide valuable insights and support them in taking actionable steps toward creating seamless customer experiences that deliver more value. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands refine their services. Whether visiting boutiques, purchasing online, or returning a product, your voice shapes the future of luxury. • Flexibility - each in-store visit takes approximately 20 minutes, giving you the flexibility to complete multiple assignments. • Frequent opportunities - perform several missions per month and collaborate with some of the most prestigious brands worldwide. What you will be doing: 1. Choose your assignments - align your missions with your personal preferences and profile. 2. Visit luxury stores or evaluate online - engage with sales associates in the stores or online from the comfort of your home. 3. Observe carefully - check the ambiance, service quality, and overall customer experience. 4. Provide honest feedback - use our platform to share your observations through questionnaires. Perks of the Role: • Collaborate with iconic brands across industries. • Flexible assignments tailored to your interests. • Compensation for your time and input, with the potential for reimbursement on purchases. • A user-friendly platform for managing missions and feedback. How to Join the CXG Community: 1. Register: sign up at live.cxg.com and confirm your email. 2. Complete your profile: fill out your details to 100% and get verified. 3. Get certified: pass the General Certification to access missions. 4. Apply for missions: explore assignments with brands that excite you. 5. Start evaluating: begin making a difference in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations: Reimbursement for approved items as stated in the mission brief. About CXG At CXG, we connect premium brands with over 80,000 evaluators across 70 countries. With 12 global offices and almost two decades of CX retail expertise, we’re committed to redefining the customer experience for luxury giants. Join us and enjoy the flexibility of working on the go with our mobile platform, CXG Live. On this platform, you can seamlessly manage missions, certifications, and feedback. Requirements Must be 18 years or older (21 years or older in the United States). Current customer of premium and luxury brands. Not currently under contract with any retail brands, to ensure impartiality. Punctual, organized, detail-oriented, and reliable. Observant and passionate about customer experience. No prior experience is required; we value honest feedback from genuine customers.