Вакансии

Location: New York, NY (HQ); San Francisco, CA Workplace: Hybrid ABOUT RAMP Ramp is building the smart infrastructure for finance teams, embedded in the transaction flow of every dollar a business spends. We automate how over $275B in annualized spend flows in and out of 85,000+ companies: authorizing payments, flagging risk, categorizing spend, and closing books. The problems are high-stakes, data-dense, and unforgiving. We hire people with high agency and high urgency. We look for slope over intercept. We care less about where you trained and more about what you’ve built. At Ramp, everyone is a builder who owns problems end to end and makes consequential decisions that shape the outcome. The median Ramp customer saves 7.5% and grows revenue 16% in their first year – far in excess of businesses operating without Ramp. We believe every ambitious company deserves the same. If you want to build systems that directly shape how companies move and manage billions, Ramp is the place to do it. ABOUT RAMP LABS Ramp Labs is Ramp's AI research group. We post-train models on finance work, build the environments and evals they learn from, and ship them into the products 70,000+ companies use to move money. We think the defensible part of an AI product is the loop: proprietary environments, evals that track what customers care about, and models trained against both. ABOUT THE ROLE Every model decision at Ramp Labs runs through a benchmark. Which model to route to. Whether a post-training run worked. Whether an agent is ready to post a corrective journal entry to a customer's ledger without a human in the loop. You'll own Ramp's benchmarking effort. You'll turn real finance work (expense policy review, invoice coding, month-end close, spreadsheet Q&A) into benchmarks and RL environments, build the graders, and tell the team what is actually improving. WHAT YOU’LL DO - Build benchmarks from real workflows: turn agent traces, customer edge cases and expert labels into versioned benchmark suites for long-horizon agents that run for hours across tools and systems, plus tool use, multi-step reasoning and financial judgment - Own the benchmarking effort: decide what we measure, run benchmark suites across models and agent versions, and report results the team makes decisions on - Design graders: rubrics, programmatic checks and llm-as-judge, calibrated against human agreement, with a clear view of where each one breaks - Close the loop with post-training: turn evals into reward functions and RL environments, and catch reward hacking and contamination before they ship - Publish external benchmarks and write-ups on how models perform at real finance work WHAT YOU NEED - Hands-on experience building LLM benchmarks or evals that people used to make real decisions - Strong Python and software engineering; your eval code is reproducible and fast - Statistical judgment: variance, confidence intervals, sample size, inter-rater agreement, and knowing when a delta is noise - Working knowledge of post-training (SFT, RL with verifiable rewards) and how evals feed into it - Comfort with SQL and large datasets; you'll work directly from production traces - Taste for what is worth measuring NICE-TO-HAVE - Industry experience on an eval, benchmarking or post-training team - Built RL environments or verifiers for agentic tasks - Published benchmark or evaluation research (NeurIPS Datasets & Benchmarks, ICML, ACL) - Built or contributed to eval frameworks (verifiers, lm-evaluation-harness, HELM or similar) - Familiarity with accounting, finance or other expert-domain work - Public work we can look at: a benchmark, an eval suite, a failure-analysis write-up BENEFITS AVAILABLE TO ALL FULL-TIME RAMP EMPLOYEES (GLOBAL) - Flexible PTO - Centralized home-office equipment ordering - Health and wellness stipend - Budget for intra-office travel - Weekly coffee stipend UNITED STATES - 100% medical, dental & vision insurance coverage for you, with partial coverage for dependents - One Medical annual membership - 401(k), including employer match on contributions made while employed by Ramp - Fertility HRA (up to $10,000 per year) - Parental leave: up to 16 weeks (birthing + bonding) or 8 weeks (bonding only) at 100% pay - Pet insurance - In-office perks: lunch, snacks, drinks, and more - Relocation expense coverage to NYC or SF (if needed) CANADA - Group medical, dental, and vision coverage through Sun Life - Life, AD&D, and disability coverage - Fertility drug coverage (up to $4,000 lifetime) - Group Retirement Plan with employer match (RRSP + DPSP) - Parental leave: up to 16 weeks (birthing + bonding) or 8 weeks (bonding only) at 100% pay, with additional time available at reduced pay - Employee Assistance Program and virtual care through Lumino Health UNITED KINGDOM - Private medical insurance through Freedom Elite - Virtual GP and at-home care via eMed x Livi - Workplace pension through Penfold, with salary sacrifice option - Parental leave: up to 16 weeks (birthing + bonding) or 8 weeks (bonding only) at 100% pay with additional time available at reduced pay REFERRAL INSTRUCTIONS If you are being referred for the role, please contact that person to apply on your behalf.   OTHER NOTICES Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.   Beware of recruiting scams: Ramp will only contact you through official @Ramp.com http://Ramp.com email addresses and will never ask for payment or sensitive personal information during the hiring process.   Ramp Applicant Privacy Notice https://ramp.com/legal/applicant-privacy-notice

Location: Brazil; Peru; Colombia; Argentina; Paraguay; Mexico; Chile Workplace: Remote BUILDING THE FUTURE OF OPEN FINANCE Payward - the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks - has spent the last 15 years building one of the most modern and globally accessible financial infrastructure platforms in the industry, built to advance an open, global financial system. THE TEAM CF Benchmarks is the leading regulated cryptocurrency index provider, authorized as a registered benchmark administrator under the UK Benchmarks Regulation. Its indices are integrated into six of the eleven spot Bitcoin ETFs in the US and power 99% of the regulated crypto derivatives market, with over $40 billion in assets referencing its benchmarks. We are looking for a Java Developer to join the CF Benchmarks Index Team. You will be responsible for implementing new financial benchmarks and for ensuring the smooth running of the CF Benchmarks platform. You should be diligent with a keen attention to detail and a track record of seeing tasks/projects through to conclusion. The ideal candidate should have experience working as a developer within fintech for at least 3 years. To learn more about CF Benchmarks, please click here https://www.cfbenchmarks.com/about/crypto-facilities   THE OPPORTUNITY - Build benchmark calculation systems based on new and innovative methodologies - Work closely with the product team to develop new features supporting business requirements in an end to end manner - Broadly contribute in the areas of data analysis, core infrastructure, core backend, business logic implementations and more - Support a 24/7 real-time distributed system as part of a wider team - Help ensuring all systems have suitable coverage with tests, metrics and alarms - Help provide world class pricing and data services to the crypto and financial world - Be part of one of the fastest growing crypto companies in the world     WHAT YOU BRING - Experience in software development, with a focus on backend development - Possess a solid foundation of Java applications - Ability to develop iteratively for a high throughput, real time system - Highly capable of writing maintainable, simple, efficient and dependable code - Understanding of modern development processes such as CI/CD, Git - Strong mathematical and reasoning skills - Strong written and verbal communication skills in English - Excellent problem-solving skills, attention to detail, and ability to work independently and as part of a team     NICE TO HAVES - Experience working with benchmarks or pricing models, or broader financial knowledge - Experience working with cryptocurrency or blockchain technology - Experience working with SQL and data analytics skills - Familiarity with common middlewares such as RPC, protobuf, message queues, Redis       Unless a specific application deadline is stated in the job posting, applications are accepted on an ongoing basis. Please note, applicants are permitted to redact or remove information on their resume that identifies age, date of birth, or dates of attendance at or graduation from an educational institution. We consider qualified applicants with criminal histories for employment on our team, assessing candidates in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance. OUR COMMITMENT Payward is powered by people from around the world and we celebrate the diverse talents, backgrounds, contributions, and unique perspectives that everyone brings to the table. We hire based on merit, seeking out people with the right abilities, knowledge, and skills for the job. We encourage you to apply for roles where you don't fully meet the listed requirements, especially if you're passionate or knowledgeable about crypto. We may ask candidates to complete job-related skills or work-style assessments as part of our hiring process. These assessments evaluate competencies relevant to the role and are applied consistently across candidates for similar positions. Results are considered alongside experience and interviews, and are not the sole basis for any employment decision. As an equal opportunity employer, we don't tolerate discrimination or harassment of any kind, whether based on race, ethnicity, age, gender identity, citizenship, religion, sexual orientation, disability, pregnancy, veteran status, or any other protected characteristic as outlined by federal, state, or local laws. Stay connected Follow us on X https://twitter.com/krakenfx Learn on the Kraken Blog https://blog.kraken.com/#:~:text=Enter%20your%20email%20address Connect on LinkedIn https://www.linkedin.com/company/kraken-exchange/ Candidate Privacy Notice https://www.kraken.com/legal/candidate-privacy-notice

Kled AI is looking for a Research Scientist Benchmarks and Evals to develop benchmarks, evaluate frontier models, and demonstrate the value of opt-in human data.

Location: Netherlands (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software engineering - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: Taiwan (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: Hong Kong (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: Brazil (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software or prompt engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: Switzerland (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software or prompt engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: Austria Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: Mexico (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: Argentina (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: Belgium (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: Canada (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: France (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: Indonesia (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: Remote, Global ABOUT SUPABASE Supabase is the Postgres development platform, built by developers for developers. We provide a complete backend solution including Database, Auth, Storage, Edge Functions, Realtime, and Vector Search. All services are deeply integrated and designed for growth. ABOUT THIS ROLE We’re hiring experienced performance engineers to make performance measurement at Supabase rigorous, repeatable, and actionable by product teams. This role owns the benchmarking and profiling systems we use to detect regressions, explain performance changes, and publish credible numbers for customers and the market. You’ll build the tooling and the methodology and make it easy for product teams to use it correctly. You’d join a new performance team as one of its first members, working alongside a deeply seasoned performance engineer, with the team growing to roughly six this year. There’s no legacy process to inherit — you’ll help define how we measure and communicate performance metrics at Supabase. WHAT YOU’LL DO - Build and evolve benchmarking, profiling, and load-testing tooling (cloud, database, and end-to-end). - Define benchmark suites and reference workloads that reflect real customer behavior (and evolve them as the products change). - Establish performance baselines and regression gates across products (variance tracking, environment control, and detection of changes). - Build mechanisms that turn benchmark results into action: triage workflows, owner routing, and clear, reproducible reports. - Partner closely with database teams (e.g. Multigres, OrioleDB) to identify bottlenecks and land concrete performance improvements. - Enable the company to publish credible, repeatable performance numbers for customers and the market. - Help teams self-serve performance testing and make performance a first-class engineering concern. PROBLEMS YOU MIGHT WORK ON - Build our continuous benchmarking infrastructure so product teams can spot performance regressions early. Ideally, teams can run benchmarks directly on PRs or locally while developing a feature. - Analyze and eliminate issues with load generators, workloads or benchmark environments to ensure that benchmarks are reliable indicators for actual product performance. - Build regression triage tooling that pinpoints what changed (diffing, profiles/traces, query-level attribution). - Help product teams so they can analyze the root cause of performance regressions in benchmark environments themselves. WHAT WE’RE LOOKING FOR - Deep experience in performance engineering, benchmarking, and profiling of complex distributed systems. Specifically, you have owned benchmarking systems where reproducibility and controlling variance mattered. - Strong systems intuition (databases, storage, networking, cloud infrastructure). - Comfortable working across product, infra, and database teams. - Pragmatic, tooling-oriented mindset with strong communication skills. - Depth on at least one end of that stack: Linux kernel internals (virtual memory, scheduling, networking, IO) or database internals (query planning, storage engines, buffer and WAL management) WHAT WE OFFER - Fully Remote We hire globally. We believe you can do your best work from anywhere. There are no Supabase offices, but we provide a WeWork membership or co-working allowance you can use anywhere in the world. - ESOP Every team member receives ESOP (equity ownership) in the company. We want everyone to share in the upside of what we’re building together. - Tech Allowance Use this budget to set up your ideal work environment—laptop, monitor, headphones, or whatever helps you do your best work. - Health Benefits Supabase covers 100% of health insurance for employees and 80% for dependents, wherever you are. Your wellbeing and your family’s health are important to us. - Annual Off-Sites Once a year, the entire company gathers in a new city for a week of connection, collaboration, and fun. It’s a highlight of our year. - Flexible Work We operate asynchronously and trust you to manage your own time. You know what needs to be done and when. - Professional Development Every team member receives an annual education allowance to spend on learning—courses, books, conferences, or anything that supports your growth. ABOUT THE TEAM Supabase was born-remote and open-source-first. We believe our globally distributed team is our secret weapon in building tools developers love. - ~400 team members - 60+ countries - 20+ languages spoken - Over $1B raised (including our $500M Series F) - 540,000+ community members We move fast, build in public, and use what we ship. If it’s in your project, we probably use it in ours too. We believe deeply in the open-source ecosystem and strive to support—not replace—existing tools and communities.

Location: China (Remote); Taiwan (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years of industry experience in software engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Location: Japan (Remote) Workplace: Remote ABOUT THE OPPORTUNITY We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. We are seeking experienced native-speaking software engineers to design, build, and validate these benchmarks. You will create high-signal, high-quality tasks that genuinely test a model's ability to handle multilingual environments without relying on English translation crutches. Note this is a remote, freelance opportunity WHAT YOU’LL DELIVER - Task Engineering: Evaluating Coding Agents. - Asset Creation: Build realistic task environments using datasets and files in your native language. Crucially, these assets must remain in the target language to genuinely measure multilingual handling. - Prompting & Translation: finding failure points where AI does not work, in your native language - Implementation & Verification: Support the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary). - Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Sonnet, Opus). - Quality Assurance: Participate in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity. QUALIFICATIONS - Experience: 1+ years in software or prompt engineering. - Background: Proven track record at leading technology companies and/or graduation from top-tier engineering universities. - Language: Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency. - Technical Stack: Strong proficiency in Python, standard shell scripting, and data processing. - Workflow: Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents. - Domain Expertise: Deep technical understanding of multilingual text processing pitfalls, including: - Encoding/decoding robustness and Unicode normalization. - Locale-dependent conventions (collation, casing, non-Gregorian dates). - Text I/O, toolchain interoperability, and safe string operations. - (For specific languages) Bidirectional/RTL handling, font fallbacks, and rendering/typography in UI or artifacts. WHY COLLABORATE WITH LILT? - Your schedule, your rules. As an independent contractor, work when you want, as much or as little as you want. No fixed hours, no check-ins, no micromanaging. - Get paid quickly and fairly. We respect your time and your expertise. Competitive rates, prompt payments, no chasing invoices. - Work on projects that actually matter. Contribute to cutting-edge AI and language technology that is shaping how humans and machines communicate. - Be part of something bigger. Join a global community of linguists, subject matter experts, and language professionals who are advancing human knowledge together. - Grow without limits. As a Lilt contractor you get access to diverse, innovative projects that expand your portfolio and sharpen your skills across industries and domains. - Have fun doing what you love. Bring your language skills to life on projects that are as interesting as they are impactful.We are building a rigorous, verifiable evaluation suite of Terminal-Bench tasks designed to test the limits of large language models on multilingual software challenges. Our goal is to measure multilingual robustness across prompt language effects, non-English data processing, and complex locale/encoding edge cases in terminal workflows. WHAT TO CONSIDER BEFORE APPLYING - Not ideal as a full time job or primary income source. Work availability fluctuates with project demand, making this better suited as a supplemental income stream. As a 1099 contractor, you won't receive benefits such as health insurance, paid time off, or retirement contributions, and hours are not guaranteed. - Requires reliable availability and commitment. Once you accept a task, we expect quality work and on-time delivery. Most tasks require a minimum of 2 hours per day or 15-20 hours per week. If your schedule is unpredictable, this may not be the right fit. - Geographic restrictions may apply. We cannot engage contractors in regions subject to international embargo or sanctions. As a 1099 contractor, you are solely responsible for your own tax obligations. We recommend consulting a tax professional before engaging. HOW TO JOIN OUR EXPERT COMMUNITY 1 - Submit your application including an updated copy of your CV in English 2 - Next, complete a GenAI assessment to evaluate your skills 3 - Finalize onboarding and profile set-up in our system, and become eligible for Applied AI projects. AI is changing how the world communicates — and LILT is leading that transformation. LILT's mission is to make the world's information available to everyone, no matter the language they speak. Join our global community who thrive on innovation and excellence. Our collective knowledge, uniqueness, and skills deliver multilingual AI and human-verified services to Enterprises, Governments, and AI Developers around the world. Earn money. Have fun. Advance human knowledge. Work on diverse projects from anywhere, any time you want. Get paid quickly and fairly, and build your professional network in a supportive community—all through a streamlined application process tailored to your expertise. Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy. At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com. LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.