Location: Remote
Workplace: Remote
We are building AI to simulate the world through merging art and science.
We believe that world models are at the frontier of progress in artificial intelligence. Language models alone won’t solve the world’s hardest problems – robotics, disease, scientific discovery. Real progress requires models that experience the world and learn from their mistakes, the same way that humans do. And this kind of trial and error can be massively accelerated when done in simulation, rather than in the real world.
World models offer the most clear path to general-purpose simulation, changing how stories are told, how scientific progress is made and how the next frontiers of humanity are reached.
Our team consists of creative, open minded, caring and ambitious people who are determined to change the world. We aspire to continuously build impossible things and our ability to do so relies on building an incredible team. If you are driven to do the same, we'd love to hear from you.
*Titles posted to our careers page are updated regularly to best advertise the role and expected seniority, but internally we have a flat titling system with two types of titles: one for individual contributors and one for people managers.
ABOUT THE ROLE
We're looking for an ML infrastructure engineer to own model evaluation at Runway, end to end. Every decision we make about a model – which checkpoint to keep training, what to ship to millions of users, which datamix and architecture shows the most promise – rests on evals. Today that work is spread across the organization. You'll turn it into one platform.
Your job will be to design and build the systems that generate samples at scale, score them with automated metrics and human annotations, track results across checkpoints and releases, and put the answers in front of researchers in minutes rather than days. You'll define what "better" means operationally – how we measure it, how confident we are, and how a result becomes a ship/no-ship decision.
You'll be embedded within research teams as a member of ML Platform, and you'll set the technical direction for evals across the company. This is an extremely high-leverage role: the quality of our models is bounded by how well we can measure them.
A PEEK AT OUR TECHNICAL STACK
Our inference and training code is written in Python (PyTorch) and is cloud-native. We leverage multiple clouds and use a combination of Kubernetes native and home-grown tooling for efficient job orchestration.
We’re big users of agentic development and operations. We have a robust internal platform and provide broad access to the latest models and harnesses.
You’ll have access to best-in-class models, agents, GPUs, storage and cloud services you need to drive a world class evaluation pipeline that helps us deliver frontier models.
WHAT YOU'LL DO
- Own the evaluation platform end to end: the tooling and systems required to generate, annotate, review and adapt at frontier scale
- Define the CLIs, APIs, GUIs and storage layers required to make this process seamless, fast, sophisticated and collaborative
- Work directly with research teams on video, image, audio, agents, and robotics to understand what they need to measure and build it, then generalize the result into the platform
- Help set the standards for how we evaluate models at Runway: reproducibility, metric definitions, reporting formats, and when a result is trustworthy enough to act on
- Support broad adoption of the platform and its integration throughout Runway’s research efforts across training, production model serving and more
- Contribute broadly as a member of the ML Platform team to tools and systems that help Runway train and serve frontier models
WHAT YOU'LL NEED
- 5+ years of experience building ML infrastructure or data platforms in production environments, with at least some of that time spent on evaluation, experimentation, or benchmarking systems
- Strong Python and PyTorch, and hands-on experience running large batch GPU workloads on Kubernetes
- Experience designing data pipelines and storage for large volumes of media or model outputs, with attention to versioning and reproducibility
- Familiarity with experimental statistics: paired comparisons, confidence intervals, multiple-comparison pitfalls, inter-rater agreement
- Comfort building internal tools end to end, from the command line to the browser
- Ability to lead a broad technical area: gather requirements from many teams, set direction, make tradeoffs, and drive a roadmap without waiting to be told
- Familiarity with the full model development lifecycle: data, training, evaluation, serving
- Self-starter who can work embedded with research teams and move fast
- Strong systems thinking and pragmatic approach to production reliability
- Humility and open mindedness; at Runway we love to learn from one another
NICE TO HAVE
- Track record of building evaluation suites for generative models
- Hands-on work with LLM- or VLM-as-judge pipelines
- Experience with online experimentation platforms and connecting offline metrics to product outcomes
- Prior work evaluating agents or robotics policies
Runway strives to recruit and retain exceptional talent from diverse backgrounds while ensuring pay equity for our team. Our salary ranges are based on competitive market rates for our size, stage and industry, and salary is just one part of the overall compensation package we provide.
There are many factors that go into salary determinations, including relevant experience, skill level and qualifications assessed during the interview process, and maintaining internal equity with peers on the team. The range shared below is a general expectation for the function as posted, but we are also open to considering candidates who may be more or less experienced than outlined in the job description. In this case, we will communicate any updates in the expected salary range.
Lastly, the provided range is the expected salary for candidates in the U.S. Outside of those regions, there may be a change in the range, which again, will be communicated to candidates.
WORKING AT RUNWAY
Great things come from great teams. https://www.youtube.com/watch?v=kwmj4ato2kw&ab_channel=Runway We’d love to hear from you.
We’re committed to creating a space where our employees can bring their full selves to work and have equal opportunity to succeed. So regardless of race, gender identity or expression, sexual orientation, religion, origin, ability, age, veteran status, if joining this mission speaks to you, we encourage you to apply.
More about Runway
- Universal World Simulator https://runwayml.com/world-simulator.html
- GWM-1 https://runwayml.com/research/introducing-runway-gwm-1
- Gen-4.5 https://runwayml.com/research/introducing-runway-gen-4.5
- General World Models https://runwayml.com/research/introducing-general-world-models
- Robotics SDK https://runwayml.com/research/introducing-runway-gwm-1#robotics-section
- Conversational Real-time Agents https://runwayml.com/research/introducing-runway-gwm-1#avatars-section
- Runway Studios https://runwayml.com/studios
We're excited to be recognized as a best place to work:
Crain's https://www.crainsnewyork.com/awards/best-places-work-2023 | InHerSight https://www.inhersight.com/companies/best/city/new-york-city-ny | BuiltIn NYC https://builtin.com/awards/new-york-city/2024/best-places-to-work | INC https://www.inc.com/best-workplaces/2024
УдалённоСША; Lastly, the provided range is the expected salary for candidates in the U.S
Location: Philippines; India
Workplace: remote
About the Role:
Review pre-segmented audio recordings, verify word-level segment accuracy, and correct timestamp or transcription errors to support training data for speech-to-speech AI models
Location: India/ Philippines (Remote)
Engagement Type: Freelance (Pilot)
Rate: USD 4.55/hour
Estimated Hours: 30 hours/week
Key Responsibilities
Listen to short audio clips and review automatically generated word-level segments (start timestamp, end timestamp, transcription)
Verify segment boundaries align with actual speech onset and offset
Review start/end timestamps when boundaries are inaccurate
Identify and flag tasks for discard per defined criteria (unintelligible audio, non-target language, sensitive content, no voice activity, etc.)
Maintain consistency and accuracy across a detailed, evolving style guide
Requirements
English fluency, including strong command of spoken/colloquial forms (contractions, filler words, informal speech)
Prior experience with audio transcription, data annotation, or speech/NLP data labeling preferred
Comfortable using annotation/labeling tools
Ability to reference and apply a detailed style guide consistently
Ability to work independently and adapt to periodic guideline updates
#L1-CC1
Location: Philippines; India
Workplace: remote
About the Role:
We are looking for experienced Adjudicators to review and resolve discrepancies in word level transcription and timestamp annotations for an English (US) speech data project. This role requires strong judgment to make final calls on flagged or disputed segments, ensuring quality and consistency across the annotation pipeline.
Project Details: Andromeda Delta
Location: Philippines & India (Remote)
Engagement Type: Contract / Freelance
Rate: USD 7.00/hour
Estimated Hours: 15–20 hours/week
Key Responsibilities
Review annotations flagged by first-pass Annotators for disagreement or ambiguity
Listen to audio clips and make final determinations on word-level segment boundaries and transcriptions
Apply the project style guide consistently to resolve edge cases
Provide clear rationale for adjudication decisions
Identify patterns in annotator errors and feedback quality observations where needed
Requirements
US cultural expertise in English; excellent listening comprehension
Prior experience in transcription/annotation QA, adjudication, or linguistic review preferred
Strong ability to apply detailed guidelines consistently and make sound judgment calls
High attention to detail and comfort working with ambiguity
Reliable internet connection and quiet working environment with good headphones
#L1-CC1
УдалённоPhilippines; India
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.
Location: California; Sunnyvale, CA; San Francisco, CA; Seattle, WA; Redmond, Washington; Burlingame, CA; New York City Metropolitan Area; Los Angeles, CA; Washington, D.C.; Boston, MA
Workplace: onsite
Overview
Welo Data is looking for sharp, curious, and detail-oriented individuals to join our team as Data Labeling Associate.
This is not a traditional annotation role.
You’ll be working directly with cutting-edge AI systems — evaluating outputs, identifying gaps, and helping improve how these systems behave in real-world scenarios. The work sits at the intersection of data quality, model evaluation, and human judgment, where your ability to think critically matters just as much as following guidelines.
We’re looking for people who are naturally curious about AI, comfortable forming opinions, and confident in contributing to conversations with teammates, leads, and stakeholders.
Project Details
Job Title: Data Labeling Associate
Hiring in: Onsite (Bay Area, Seattle, NYC, or client-dependent)
Hours: Full-time, 40 hours per week
Employment Type: W2 Full-Time Employee
Work Authorization: Must be authorized to work in the U.S. (no visa sponsorship)
Pay Rate: $34/hour
Important: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston, Austin. Please only apply if you meet this location requirement.
What You’ll Do
Evaluate AI model outputs and provide structured, high-quality feedback
Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes
Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios
Contribute to improving evaluation frameworks, not just executing them
Identify trends in model performance and communicate insights clearly
Participate in team discussions, calibrations, and stakeholder syncs
Partner with leads and cross-functional teams to refine quality standards
Document findings in a clear, concise, and actionable way
What We’re Looking For
Native-level Tamil language proficiency
and a
university degree
(Bachelor’s or higher).
B2 or superior level of English.
1–2 years of professional writing experience with strong, structured writing skills
Ability to apply complex writing rules and guidelines consistently
Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
Strong critical thinking and attention to detail
Ability to make sound judgment calls in ambiguous situations
Naturally curious about AI, technology, and how systems behave
Comfortable speaking up, asking questions, and contributing ideas
Strong written and verbal communication skills
Ability to stay consistent while working with evolving guidelines
Experience in data quality, QA, annotation, or analysis is helpful — but not required
Benefits
Paid Vacation: 6 days
Paid Company Holidays: 2 days (Memorial Day and Labor Day)
Paid Sick Leave: accrued per applicable state law and company policy
Medical, Dental, and Vision Insurance (eligibility applies)
Health Savings Account (HSA)
401(k) Retirement Plan
Employee Assistance Program
Additional voluntary benefits (life, accident, critical illness, etc.)
Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
Unique Campus Features: Some locations include roof-top nature parks
Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.
Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.
To know more details (Click here)
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire. In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them. www.welocalize.com
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.
Why This Role
This is an opportunity to move beyond traditional data work and play a direct role in how AI systems are evaluated and improved. The work is fast-moving, collaborative, and increasingly central to how modern AI systems are built and deployed.
Location: New York, NY
Workplace: OnSite
ABOUT US
At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.
With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.
Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.
ABOUT THE TEAM
The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done.
ABOUT THE ROLE
We're looking for a Product Manager to own key parts of LangSmith. Building AI products is changing the way software teams work; LangSmith is the observability, evals and deployment platform that makes shipping reliable AI systems possible.
WHAT YOU'LL DO
This role sits at the intersection of user experience and production infrastructure. You'll partner with engineers to build features that feel intuitive while solving deeply technical problems: versioning complex prompt chains, debugging multi-step agent failures, or designing evaluation systems that scale from 10 to 10,000 test cases.
You'll work directly with customers — from early-stage startups shipping their first agent to enterprises running mission-critical AI systems — to understand where the platform breaks down and what capabilities unlock new workflows.
- Own the roadmap for a core area of the LangSmith platform.
- Work with customers to understand their challenges and define new product features.
- Work with engineering to define scope, make technical tradeoffs, and ship high-impact features quickly.
- Help shape product strategy alongside our founders and leadership team.
WHAT YOU'LL BRING
- 3+ years of product management or engineering experience, ideally building developer tools, infrastructure products, or technical SaaS platforms.
- Deeply technical — you can hold your own in conversations about API design, system architecture, data pipelines, and debugging production issues.
- Bias toward action — you'd rather ship, learn, and iterate than build the perfect solution upfront.
- Strong written and verbal communicator who can align cross-functional teams around a shared vision.
NICE TO HAVE
- Computer Science, Engineering, or equivalent technical background.
- Previous experience at a high-growth startup or developer-focused company.
- Hands-on experience building with LLMs, agents, or AI applications.
- Annual salary range: $180,000-$240,000
Compensation Philosophy:
We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.
We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.
BENEFITS
Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
Location: California; Sunnyvale, CA; San Francisco, CA; Seattle, WA; Redmond, Washington; Burlingame, CA; New York City Metropolitan Area; Los Angeles, CA; Washington, D.C.; Boston, MA
Workplace: onsite
Overview
Welo Data is looking for sharp, curious, and detail-oriented individuals to join our team as Data Labeling Associate.
This is not a traditional annotation role.
You’ll be working directly with cutting-edge AI systems — evaluating outputs, identifying gaps, and helping improve how these systems behave in real-world scenarios. The work sits at the intersection of data quality, model evaluation, and human judgment, where your ability to think critically matters just as much as following guidelines.
We’re looking for people who are naturally curious about AI, comfortable forming opinions, and confident in contributing to conversations with teammates, leads, and stakeholders.
Project Details
Job Title: Data Labeling Associate
Hiring in: Onsite (Bay Area, Seattle, NYC, or client-dependent)
Hours: Full-time, 40 hours per week
Employment Type: W2 Full-Time Employee
Work Authorization: Must be authorized to work in the U.S. (no visa sponsorship)
Pay Rate: $34/hour
Important: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston, Austin. Please only apply if you meet this location requirement.
What You’ll Do
Evaluate AI model outputs and provide structured, high-quality feedback
Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes
Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios
Contribute to improving evaluation frameworks, not just executing them
Identify trends in model performance and communicate insights clearly
Participate in team discussions, calibrations, and stakeholder syncs
Partner with leads and cross-functional teams to refine quality standards
Document findings in a clear, concise, and actionable way
What We’re Looking For
Native-level Marathi language proficiency
and a
university degree
(Bachelor’s or higher).
B2 or superior level of English.
1–2 years of professional writing experience with strong, structured writing skills
Ability to apply complex writing rules and guidelines consistently
Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
Strong critical thinking and attention to detail
Ability to make sound judgment calls in ambiguous situations
Naturally curious about AI, technology, and how systems behave
Comfortable speaking up, asking questions, and contributing ideas
Strong written and verbal communication skills
Ability to stay consistent while working with evolving guidelines
Experience in data quality, QA, annotation, or analysis is helpful — but not required
Benefits
Paid Vacation: 6 days
Paid Company Holidays: 2 days (Memorial Day and Labor Day)
Paid Sick Leave: accrued per applicable state law and company policy
Medical, Dental, and Vision Insurance (eligibility applies)
Health Savings Account (HSA)
401(k) Retirement Plan
Employee Assistance Program
Additional voluntary benefits (life, accident, critical illness, etc.)
Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
Unique Campus Features: Some locations include roof-top nature parks
Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.
Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.
To know more details (Click here)
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire. In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them. www.welocalize.com
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.
Why This Role
This is an opportunity to move beyond traditional data work and play a direct role in how AI systems are evaluated and improved. The work is fast-moving, collaborative, and increasingly central to how modern AI systems are built and deployed.
Location: UK, London
Workplace: OnSite
Here at Humanoid, we believe in a future where robots amplify human potential. That’s why we’ve set out on a mission to build the world’s most capable, commercially-scalable, and safe humanoid robots. We’re bringing that mission to life with HMND‑01 - our rapidly developed humanoid platform being deployed in real industrial environments - and we’re growing the team to take it even further.
ABOUT THE ROLE
As a Humanoid Robot AI Data Collector, you will teleoperate humanoid robots and follow well-defined procedures to generate high-quality datasets used for training advanced AI models. You will work hands-on with physical robots using on-site tools and interfaces—such as the Universal Manipulator Interface (UMI)—to execute structured tasks and capture precise data. A significant part of the role involves annotation and labeling, requiring strong focus, accuracy, and pride in craftsmanship.
This role is for individuals who thrive in a fast-moving, team-oriented environment; who take ownership, communicate openly, and embrace continuous learning. No technical background or formal education is required; full training is provided. This is a fully on-site role, working hands-on with robots and on-site systems such as UMI, and may involve periods of standing, regular movement, and interaction with physical hardware.
This position is a permanent night shift, with working hours of 10:30 pm - 6:30 am, and may require occasional travel in line with business needs.
WHAT YOU'LL DO
- Teleoperate humanoid robots with consistency, precision, and a strong sense of ownership over data quality.
- Perform on-site data collection using tools such as the Universal Manipulator Interface (UMI).
- Capture and organise multimodal data (e.g., video, motion trajectories, task logs) with high accuracy and attention to detail.
- Annotate and label data following strict guidelines, treating the work as a high-skill technical discipline.
- Identify anomalies or issues proactively and escalate or solve them at the lowest responsible level.
- Suggest improvements to workflows, processes, or tools—everyone contributes to process design.
- Maintain clear, transparent documentation of progress and dataset quality.
- Move with urgency and focus, ensuring timelines and daily goals are met.
- Communicate openly with team members, sharing feedback and observations across functions.
- Collaborate respectfully and positively with teammates, helping create a supportive and high-performing culture.
WE'RE LOOKING FOR:
- No formal technical education required — full training will be provided.
- Comfortable using computers and digital interfaces.
- Exceptional attention to detail and ability to follow precise instructions.
- Strong time management, urgency, and reliability in meeting daily/weekly targets.
- Ability to maintain focus and high-quality output during repetitive tasks.
- Proactive mindset — willingness to take initiative without waiting for direction.
- Clear, transparent communication skills for reporting findings and collaborating with the team.
- Commitment to iterative learning, continuous feedback, and constant improvement.
- Interest in robotics, AI, or emerging technologies is welcome but not required.
WHAT WE OFFER:
- 30+ days time off, including 23 days annual leave, all UK bank holidays, and additional company closure days (including Christmas–New Year shutdown).
- Private healthcare, including virtual and in-person care.
- Pension scheme with 8% total contribution (5% employee, 3% employer) on full earnings.
- Free daily breakfast, catered lunch, and snacks in-office.
- Work at the frontier - collaborate daily with world-class engineers, researchers, and product experts building the next generation of AI and humanoid robotics.
- Real ownership - direct access to founding leadership, meaningful input on product direction, and the ability to drive key initiatives from day one.
Location: Boston, MA
Workplace: OnSite
ABOUT US
At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.
With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.
Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.
ABOUT THE TEAM
The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done.
ABOUT THE ROLE
(Onsite in Boston)
We’re looking to bring on an experienced frontend engineer to develop and enhance new features on LangSmith, our enterprise platform product for LLM application observability, testing, and debugging.
WHAT YOU WILL DO
- Develop new user-facing features using React & Typescript
- Build reusable components and front-end libraries for future use
- Translate designs and wireframes into high-quality code
- Optimize components for maximum performance across a vast array of web-capable devices and browsers
- Collaborate with fullstack and backend developers and UX/UI designers, to enhance usability
WHAT YOU WILL BRING
- Extensive front-end engineering experience with strong proficiency in React, JavaScript and TypeScript
- Hands-on experience with front-end development tools like Babel, Vite, Webpack, NPM, and Yarn
- Familiarity with REST APIs and experience working closely with fullstack and backend engineers
- Knowledge of modern authorization mechanisms, such as JWTs
- A passion for user experience, design and building clean, engaging, and intuitive interfaces
- Strong written and oral communication skills, with the ability to explain technical concepts clearly and concisely to both technical and non-technical stakeholders
- The DNA to thrive in a start-up, fast-paced environment. Views unstructured environments as an opportunity to figure out the most impactful work and help define the future success of the company
- An ownership mind-set. You are self-driven and look for opportunities to make an impact.
- Strong computer science fundamentals, ideally with a degree in computer science or related field
Annual salary range: $170,000-$235,000 USD
Compensation Philosophy:
We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.
We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.
BENEFITS
Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
Location: San Francisco, CA | Seattle, WA | New York City, NY | Washington, DC
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
Anthropic’s Safeguards Enforcement team detects and mitigates misuse of Claude, and much of that work depends on people: a growing human review workforce made up of full-time staff, contractors, vendors and BPO partners. As that workforce scales across a widening range of harm areas, the programs that bring people in, give them the right access, and roll them off cleanly have to keep pace.
As Program Manager for Safeguards Workforce Operations, you’ll own those programs end to end. You’ll run onboarding, offboarding, device provisioning and access provisioning for every worker type we use, working hands-on with the requests themselves while you build the processes that make them repeatable. You’ll partner with Enforcement leads to turn shifting priorities into capacity plans, and carry those plans through with our vendor partners. Because this role supports every Safeguards Enforcement program, you’ll also connect the dots across Anthropic, working with IT, People Operations, Security, Contingent Workforce, Human Data Operations and other teams running scaled human review to streamline practices and keep standards consistent.
This is a role for someone who likes fixing broken things at speed. The landscape moves quickly, priorities change often, and the work is an even mix of direct execution and program building.
Key responsibilities
Own the workforce lifecycle for contractor, vendor and BPO reviewers: onboarding, offboarding, device provisioning and access provisioning
Triage and execute inbound requests for new or changing vendor, BPO and contractor capacity
Turn ad hoc or broken processes into scalable ones, with clear owners, service levels and a system of record
Partner with IT and Security on access governance: least-privilege provisioning, timely revocation and regular access reviews
Build and maintain capacity plans with Enforcement leads, translating review demand into workforce needs and adjusting as priorities shift
Work with Safeguards vendor management to hold partners accountable to capacity and onboarding commitments
Align practices with Human Data Operations and other teams running scaled human review, and help them streamline their own workflows
Help define the long-term workforce strategy for Safeguards Enforcement
Minimum qualifications
Have personally run onboarding, offboarding, access and device provisioning for contractor, vendor or BPO workforces — doing the work, not only overseeing it
Have operated scaled human review programs with vendors or BPOs, such as trust & safety, content moderation or data annotation operations
Have taken a broken or ad hoc process, made it scalable, and brought other teams along in adopting it
Understand the fundamentals of capacity planning: how volume, handle time, quality targets, ramp and attrition turn into workforce needs
Exercise sound judgment on access and permissions, and know when to bring in IT or Security
Move quickly and stay effective when priorities change and information is incomplete
Build alignment through direct partnership with the teams you depend on
Preferred qualifications
Owned a vendor or BPO relationship directly, including service levels and business reviews
Built formal capacity models for review or operations workforces
Supported workforces across more than one enforcement or harm area
Hands-on experience with device management and identity and access tooling
Worked through a period of hypergrowth where programs had to mature alongside the organization
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$245,000
—
$285,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Gana dinero grabando actividades de tu vida diaria.
Buscamos personas para grabar actividades cotidianas desde una perspectiva en primera persona utilizando una aplicación móvil.
Puedes grabar tareas que ya realizas normalmente, como:
— Cocinar
— Limpiar
— Doblar ropa
— Ordenar espacios
— Hacer jardinería
— Pasear al perro
Los videos ayudan a entrenar sistemas de IA y robótica para comprender cómo las personas interactúan con el mundo real.
Lo que ofrecemos:
— Horarios flexibles
— Trabajo remoto por proyecto
— USD $6 por hora de contenido aprobado
— Bono adicional por la primera hora aprobada
Requisitos:
— iPhone 12 o superior, Google Pixel 6+ o Samsung Galaxy S21+ o superior
— Acceso a internet
— Nivel básico de inglés para registrarte y utilizar la plataforma
No se requiere experiencia previa.
Location: United States; Mexico; Canada; United Kingdom
About Us
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
Our client is supporting the development of advanced AI systems through expert legal review, research, and evaluation.
We are looking for experienced
family law attorneys
to analyze legal scenarios, review and annotate legal documents, and provide high-quality legal reasoning for AI training and evaluation. The work focuses on
family law research, case analysis, legal drafting, document review, and interpretation of statutes and precedent
. No prior AI experience is required.
CONTRACT: Short-term contractor assignment (1099)
LOCATIONS: Remote USA
HOURLY RATE: $140 - $400/h
NOTES: Active legal licensure and demonstrated expertise in U.S. immigration law are required.
Responsibilities
Analyze complex
family law cases, statutes, and precedents
.
Conduct legal research and prepare concise summaries and case notes.
Draft, review, and annotate family law documents such as custody agreements, divorce decrees, and prenuptial agreements.
Identify key legal issues, arguments, reasoning, and risk areas in case files.
Evaluate AI-generated legal content for accuracy, clarity, and legal soundness.
Provide structured feedback and corrections where needed.
Explain nuanced family law concepts in clear, precise written language.
Collaborate with remote project teams using digital tools.
Maintain a high standard of legal accuracy, consistency, and attention to detail.
Requirements
Active license to practice law in a relevant jurisdiction.
Strong professional experience in
family law
.
Experience handling complex family law matters in a
BigLaw, leading law firm, or comparable high-complexity legal environment
.
Strong legal research, writing, and case-analysis skills.
Experience drafting or reviewing family law agreements, court documents, or legal memoranda.
Proven ability to interpret statutes, case law, and legal precedent.
Strong ability to review complex legal documents and identify material issues.
Excellent written and spoken
English
.
УдалённоUnited States; Mexico; Canada; United Kingdom
Location: Toronto; Canada
Workplace: Remote
WHO ARE WE?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
WHY THIS ROLE?
This role is for people who love building tools for their coworkers. The Internal Applications team creates tools that help us create better models. In this role you will collaborate with internal stakeholders, which include annotators, ML researchers, product managers and more. Join our team of builders who create tooling that will pave the way for the next generation of large language models!
AS A FULL-STACK SOFTWARE ENGINEER ON THE INTERNAL APPLICATIONS TEAM, YOU WILL:
- Work with a small talented and enthusiastic team of software engineers
- Contribute to delightful experiences for our user-facing products, meticulously crafting code for browsers and servers
- Collaborate and grow with your engineering colleagues of all levels through direct pairing sessions, architectural designs, documentation and talks
- Identify and remove roadblocks to enable your team to increase its engineering velocity.
- Build resilient systems that are mission-critical
- Keep up with the cutting edge and adopt new technologies to improve performance and reliability
YOU MAY BE A GOOD FIT IF:
- You have experience shipping products with a large number of stakeholders
- You’re comfortable with the front and back end of the stack, and have previously worked with Next.js, TypeScript, React, and Python
- You have hands-on experience with complex SQL queries
- You have excellent communication skills and believe that documentation is a great way to get feedback and discuss technical implementations and designs
- You’re excited to add new technologies to your toolbox and use them where it makes sense
- You have the ability to take complex needs and goals and develop easy to understand explanations for all audiences
- You’re excited about AI and have the motivation to scale a company
FULL-TIME EMPLOYEES AT COHERE ENJOY THESE PERKS:
- A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
- Full health and dental benefits, including a separate budget for mental health.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months, for either parent.
- Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days!)
- Budget for traveling to other offices if you are remote, plus an annual company offsite.
HOW AND WHERE WE WORK:
- Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
- For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
- For those not near an office: a co-working benefit so you can work alongside others in your city.
- Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form https://docs.google.com/forms/d/12a6IrLdF3kI2nonKSr4tiFuz18rLQbaeYV-JM9L4o9Q/edit, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers https://cohere.com/careers page.
Location: Santa Clara, CA
Workplace: onsite
Role Overview
We are looking for a Senior Software Engineer to own the systems that power a large-scale data collection operation, including the collection platform, operator tooling, data pipeline, and fleet infrastructure.
This is an engineering role. Day-to-day teleoperation is performed by a dedicated operator team that you direct — you build what they run on, and you own what comes out of it.
Project Details
Location: 100% Onsite (Santa Clara, CA, US)
Employment: Full-time W-2, Monday–Friday, 9:00 AM–5:00 PM
Start Date: ASAP
Contract Duration: 12-month contract with possibility of extension
Rate: $105/hour
What You’ll Do
Design, build, and maintain the software behind our data collection stations — teleoperation stack, multi-camera recording, and session tooling.
Deploy and upgrade that stack across the fleet without stopping collection; keep workstations, containers, and networking healthy.
Own the data pipeline end to end: automated validation, conversion into our dataset format, upload, metadata, and versioning.
Build the QA tooling that catches dropped frames, stream desync, bad calibration, and mislabeled episodes before data reaches training.
Direct a team of teleoperators — define task protocols and SOPs, onboard them on new tasks and embodiments, review session quality, and unblock them daily.
Own fleet reliability: calibration and firmware pipelines, sensor and end-effector integration, root-cause analysis of recurring faults, and vendor escalation.
Bring up new stations and new embodiments; report throughput, yield, and data health to the research team.
What we need to see
MS in CS, Robotics, EE/ME, or a related field (or BS with equivalent hands-on experience).
3+ years building software for real robot systems — not simulation only.
A system you designed and shipped that other people depended on daily, and that you kept running.
Strong Python and Linux; Docker, git, CI, and SSH-based fleet administration.
Robot middleware and real-time multi-sensor recording — ROS 2 or equivalent vendor SDKs.
Experience supporting a data collection or teleoperation operation: you have built the tools operators depend on and owned throughput and quality numbers.
Comfortable around robot hardware — arms or humanoids, dexterous hands, RGB-D cameras, and the calibration that keeps them honest.
Able to lead operators without formal authority: you write clear SOPs, train people, and communicate status without being asked.
Ways to stand out from the crowd
Humanoid or bimanual platforms (Unitree, Fourier, ALOHA/ARX-class rigs) and dexterous hands.
XR teleoperation: Quest / PICO / Vision Pro, motion-capture gloves, whole-body retargeting.
Imitation-learning data tooling — LeRobot, HDF5/Zarr episode stores, dataset versioning, S3 at TB–PB scale.
Built internal dashboards or tooling for a production line or high-throughput lab.
Open-source contributions to robotics data or teleoperation tooling.
#L1-CC1
Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.
To know more details (Click here)
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire. In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them. www.welocalize.com
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.
Location: Boston, MA; New York, NY
Workplace: OnSite
ABOUT US
At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.
With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.
Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.
ABOUT THE TEAM
The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done.
ABOUT THE ROLE
This role is onsite 5 days/week in Boston, MA
We're looking for a Senior Fullstack Engineer to work on LangSmith. In this role, you'll have the opportunity to shape the technical direction of our platform while working closely with our enterprise customers, developer end-users, and cross functional internal stakeholders.
WHAT YOU WILL DO
- Lead the technical architecture and implementation of key product features for LangSmith, working across our entire Go, Python, and Typescript stack.
- Collaborate closely with product and design teams to iterate on new features.
- Help drive aggressive project timelines while ensuring high engineering standards are being met.
- Lead by example in writing clean, maintainable, and well-tested code.
WHAT YOU BRING
- 5+ years of experience in software engineering working on complex platform products
- Fullstack engineering experience with Go or Python on the backend and React + Typescript on the frontend.
- Strong understanding of database systems, particularly Postgres and Redis
- Experience designing and scaling APIs, preferably in a high-performance, data-intensive application
- A “get stuff done” attitude - comfortable shipping fast and iterating based on user feedback
- Strong communicator with the ability to collaborate closely with various internal stakeholders and engage directly with our top-tier customers
- Strong ownership mindset
- Bonus: Experience with AI/LLM-powered applications, developer tools, or observability platforms
Compensation
- Annual salary range: $175,000-$240,000 USD
Compensation Philosophy:
We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.
We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.
BENEFITS
Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
Location: Boston, MA; New York, NY
Workplace: OnSite
ABOUT US
At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.
With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.
Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.
ABOUT THE TEAM
The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done.
ABOUT THE ROLE
This role is based onsite in Boston, MA.
We are looking for a Senior Backend Engineer to join our growing engineering team in Boston. In this role you will be building the backend systems that power LangSmith, LangChain’s observability and evals platform. You will work on the core services that allow our customer's developer teams to monitor and evaluate their AI applications at scale. While the focus is on backend feature development, familiarity with fullstack or frontend engineering, performance tuning, and debugging production issues would be valuable.
WHAT YOU'LL DO:
- Design, develop, and maintain backend services and APIs to support LangSmith’s tracing, monitoring, and evaluation workflows.
- Collaborate on architectural decisions to ensure systems are performant and maintainable.
- Optimize storage and query performance for high-volume observability and evaluation data.
- Ensure system reliability through strong testing, monitoring, and alerting practices.
- Troubleshoot and resolve production issues, performing root-cause analysis and implementing long-term fixes.
- Create and maintain technical documentation, including system design and API references.
- Work closely with full-stack engineers, product managers, and product designers on rolling out new features.
WHAT YOU'LL BRING:
- 4+ years of professional experience in backend engineering working on highly complex products
- Proficiency in one or more backend languages/frameworks, ideally Python and/or Go
- Strong understanding of API design and building reliable data services.
- Experience with high-throughput, mission-critical systems.
- Demonstrated ability to optimize backend services for performance and reliability.
- Experience with database systems (Postgres, Redis, Clickhouse), and cloud platforms (AWS, GCP, Azure) would be a bonus.
- Strong communication skills, with the ability to collaborate cross-functionally.
- Customer centricity and ownership mentality
Annual salary range: $170,000- $235,000
Compensation Philosophy:
We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.
We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.
BENEFITS
Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
Location: Boston, MA
Workplace: OnSite
ABOUT US
At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.
With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.
Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.
ABOUT THE TEAM
The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done.
ABOUT THE ROLE
We’re looking for an Engineering Manager to lead the team building LangSmith, our observability and evaluation platform for LLM applications. You’ll define the technical direction, grow and mentor a world-class engineering team, and partner with product and design to deliver features that help developers build and deploy trustworthy AI systems with confidence.
WHAT YOU'LL DO
- Build, mentor, and grow a high-performing team of engineers, fostering collaboration, ownership, and accountability
- Strengthen LangChain’s engineering culture through mentorship, high-quality code, and technical excellence
- Shape long-term technical direction and ensure scalability and reliability of LangSmith AI Observability Platform
- Partner with product and design teams to define scope, sequence, and success criteria for key initiatives
- Maintain a high bar for technical excellence while making sure the team moves with urgency and focus
- Lead by example in writing clean, maintainable, and well-tested code in Go/Python and Typescript
- Engage directly with customers to understand their needs and translate them into actionable product improvements
WHAT YOU'LL BRING
- Experience managing or tech-leading teams delivering complex full-stack products
- Strong technical background in Go/Python and React/Typescript
- Solid understanding of databases (Postgres, Redis and ClickHouse)
- Proven ability to design high throughput data-intensive systems
- Bias towards shipping quickly and learning from customers
- Strong communication skills—able to collaborate with internal stakeholders and engage directly with customers
- Bonus: Experience building AI/LLM-powered applications, developer tools, or observability platforms
Annual salary range: $220,000- $270,000
Compensation Philosophy:
We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.
We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.
BENEFITS
Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
Location: South Africa; United Kingdom; United Arab Emirates; Namibia; Spain; Germany
About Huzzle
At Huzzle, we connect exceptional talent with top opportunities at leading companies across the UK, US, Canada, Europe, and Australia. Our clients include fast-growing startups, digital agencies, SaaS companies, and tech-enabled businesses across industries such as MarTech, FinTech, EdTech, and eCommerce. Unlike traditional outsourcing agencies, we place you directly with innovative companies where you become a valued member of the team.
Job Type: 2 week Project
Engagement: Independent Contractor
Job Summary
Are you a sales professional who knows QuickBooks inside and out and wants to shape the future of Artificial Intelligence? This team is seeking experienced Sales Development Representatives and Sales Ops experts to stress-test frontier AI systems. In this role, you will use your real-world expertise to challenge AI models with complex sales scenarios, ensuring they can handle the nuances of pricing, forecasting, and customer communication. Your work will directly influence how the next generation of AI supports global sales teams.
Key Responsibilities
Develop realistic, high-complexity sales prompts that mimic the daily demands of a Sales Manager or Business Owner.
Create tasks involving tiered pricing, discount structures, and QuickBooks data exports to test the model’s ability to generate accurate pipelines and forecasts.
Produce high-quality deliverables including spreadsheets, quotes, proposals, and outbound email sequences.
Evaluate AI-generated outputs with a critical eye, reviewing them as you would a junior rep’s work before it reaches a client.
Author objective scoring rubrics with precise, checkable criteria to allow other professionals to grade model performance consistently.
Requirements
5+ years of experience in Sales, Account Management, or Sales Operations with a proven track record of hitting targets.
3-4+ years of hands-on experience using QuickBooks (Online or Desktop) for estimates, invoicing, and sales reporting.
Exceptional written English and an uncompromising eye for detail.
Immediate availability to commit 40 hours per week for a 2-week intensive engagement.
Ability to work independently as a contractor and deliver high-quality work on a flexible schedule.
Nice-to-Haves
Prior experience in data annotation or training AI models.
Deep familiarity with CRM workflows and advanced sales automation tools.
УдалённоSouth Africa; United Kingdom; United Arab Emirates; Namibia; Spain; Germany
Location: North Macedonia; Serbia; Bosnia and Herzegovina; Albania; Georgia; Greece
About Huzzle
At Huzzle, we connect exceptional talent with top opportunities at leading companies across the UK, US, Canada, Europe, and Australia. Our clients include fast-growing startups, digital agencies, SaaS companies, and tech-enabled businesses across industries such as MarTech, FinTech, EdTech, and eCommerce. Unlike traditional outsourcing agencies, we place you directly with innovative companies where you become a valued member of the team.
Job Type: Part-time / Short-term Contract (40 hours per week for 2 weeks)
Engagement: Independent Contractor
Job Summary
This team is on a mission to stress-test the next generation of frontier AI systems to see if they can handle the rigors of real-world sales operations. We are looking for a seasoned Account Executive with deep QuickBooks expertise to serve as a subject matter expert. In this role, you won't just be selling; you will be the "manager" and "adversary" for the world’s most advanced AI models. Your goal is to design complex sales scenarios that challenge these systems and develop the grading rubrics used to evaluate their performance. If you are a sales pro who knows how to spot a mistake in a quote from a mile away, your expertise is needed to shape the future of AI in business.
Key Responsibilities
Create realistic, high-difficulty sales prompts based on real-world scenarios a sales manager, customer, or business owner would encounter.
Develop complex tasks including tiered pricing quotes, commission calculations, and converting QuickBooks sales exports into pipeline/forecast reports.
Run prompts against frontier AI models and perform "manager-level" reviews of the output to identify errors in logic, math, or professional tone.
Author objective scoring rubrics for each task, ensuring that other reviewers can consistently grade the AI's output based on pass/fail criteria (e.g., "The quote does not exceed the 15% discount cap").
Produce working deliverables such as spreadsheets, proposals, and email sequences that serve as "Gold Standard" examples for the AI to follow.
Requirements
5+ years of experience in Sales, Account Management, or Sales Operations with a proven track record of hitting targets.
3-4+ years of hands-on experience using QuickBooks (Online or Desktop) for estimates, invoicing, customer records, and sales reporting.
Precise attention to detail and excellent written English skills.
Ability to commit to 40 hours per week for a high-intensity 2-week engagement.
Strong analytical mindset with the ability to break down complex sales workflows into objective, checkable steps.
Nice-to-Haves
Prior experience in AI data annotation or prompt engineering.
Experience in sales coaching or managing junior reps (reviewing their work for accuracy).
Technical proficiency in spreadsheet modeling and data visualization.
ОфисCalifornia; Sunnyvale, CA; San Francisco, CA; Seattle, WA; Redmond, Washington; Burlingame, CA; New York City Metropolitan Area; Los Angeles, CA; Washington, D.C.; Boston, MA; To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston, Austin
ОфисNew York, NY
ОфисCalifornia; Sunnyvale, CA; San Francisco, CA; Seattle, WA; Redmond, Washington; Burlingame, CA; New York City Metropolitan Area; Los Angeles, CA; Washington, D.C.; Boston, MA; To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston, Austin
ОфисUK, London
ОфисseniorBoston, MA
География найма не уточнена
УдалённоseniorToronto; Canada
ОфисseniorГеография найма не уточнена
ОфисseniorBoston, MA; New York, NY
ОфисseniorBoston, MA; New York, NY
ОфисГеография найма не уточнена
УдалённоNorth Macedonia; Serbia; Bosnia and Herzegovina; Albania; Georgia; Greece