Location: Limassol; Nicosia; Athens; Thessaloniki; Fully Remote - in other eligible locations
Workplace: hybrid
The Role:
We're seeking a Senior AI QA Test Automation Engineer to take a leading technical role in AI quality and test automation. You will work primarily with our AWS Bedrock AgentCore-based CX Agent Suite, a multi-agent customer-support system covering intent routing, FAQs, deposit-status queries, and human handoff. You will design and build the evaluation and QA tooling required to validate AI agents reliably, while also contributing to technical standards and best practices across QA.
This is a Senior Individual Contributor (IC) role with a strong technical and strategic focus. You'll work closely with QA leadership, Data Science, and Engineering to architect scalable AI evaluation systems, establish technical standards, and drive the evolution of our AI evaluation framework. Our current evaluation harness is based on DeepEval and is evolving towards a broader agentic evaluation architecture. You will have the opportunity to evaluate and prototype emerging agent-orchestration approaches, including Strands Agents, and contribute to architectural decisions around their adoption.
The main responsibilities of the position include:
Act as the primary technical enabler for QA, building scalable AI/ML frameworks, libraries, and tooling for the CX Agent Suite and beyond
Design and build AI evaluation pipelines that assess the CX Agent Suite's multi-agent responses (Intent Detector, FAQ Agent, Missing-Deposits Agent) for accuracy, relevance, tone, hallucination rate, safety/guardrail compliance, and task completion — extending or replacing the current DeepEval-based evaluation harness
Evaluate and prototype Strands Agents (or comparable agent-orchestration frameworks) for building self-evolving, autonomous QA agents, and drive the go/no-go decision on adoption
Collaborate with QA, Data Science, and Engineering to integrate AI-driven testing into the existing GitLab CI/CD pipeline (dev → test → staging → prod), alongside Terraform-provisioned, EKS/AgentCore-hosted services
Build resilient and adaptive automation that can detect and respond to changes in agent behavior, Bedrock Guardrails configuration, and routing logic
Develop data-driven quality analytics, including root-cause analysis, quality trends, and intelligent test prioritization, leveraging existing observability and evaluation data from OpenTelemetry, CloudWatch, X-Ray traces, and LangFuse offline evaluation runs
Lead research into emerging AI testing methodologies and mentor engineers through code reviews, workshops, and architectural guidance
Main requirements:
BSc/MSc in Computer Science, AI, or a related discipline
6+ years of hands-on experience in QA/Test Automation, with strong experience designing and maintaining automation frameworks
1+ years of experience applying AI/ML in software testing or QA process improvement, with a proven track record of bringing AI/ML solutions into production workflows
Strong Python skills, with experience working in Python/AWS-centric technology environments; Java and/or TypeScript is a plus
Hands-on experience with LLM evaluation techniques, including LLM-as-a-judge, human-in-the-loop evaluation, RAG, and multi-agent orchestration patterns
Practical experience with DeepEval or comparable evaluation frameworks, along with familiarity with agent-orchestration SDKs such as Strands Agents
Knowledge of LLM tooling, vector databases, and MLOps pipelines
Experience integrating AI tooling into enterprise CI/CD environments, particularly GitLab, and working with containerized cloud-native environments such as Docker and Kubernetes/EKS
Strong communicator, able to influence technical decisions and drive engineering standards across teams
The following will be considered an advantage:
Experience with autonomous QA agents or agentic orchestration frameworks for self-evolving test suites
Experience with LLM observability tools such as LangFuse, LangSmith, or Arize, particularly for measuring probabilistic and adversarial robustness
Knowledge of AI ethics, fairness, and bias detection for guardrail and model validation
Experience with gRPC, WebSockets, and/or HTTP/2
Experience with AWS Bedrock, plus familiarity with GCP Vertex AI and/or Azure AI
Benefit from:
Attractive remuneration package
Intellectually stimulating work environment
Continuous personal development and international training opportunities
The Hiring Experience: What Awaits You
Let’s Connect – Intro Chat with Talent Acquisition
Deep Dive – First Interview with Your Future Team
Final Connection – Final Interview
All applications will be treated with strict confidentiality!
By submitting this application, I confirm that I have read and agree to the terms of the Privacy and Data Protection Notice and the Confidentiality Undertaking.
ГибридseniorLimassol; Nicosia; Athens; Thessaloniki; Fully Remote - in other eligible locations
Location: Germany
Workplace: remote
About the Project
Project Hydrus is a scripted and conversational audio data collection project. The recordings produced help build natural, everyday-sounding synthesized voices for conversational AI products — voices that sound like real people talking, not scripted performances.
As Session Director, you'll lead live recording sessions with Voice Contributors, guiding them through scripted scenarios to produce natural, conversational-quality audio. This hands-on role blends creative direction, coaching, and technical audio judgment — making scripted material sound authentic and unscripted, rather than recited, while keeping sessions moving at a natural pace.
What You'll Do
- Direct voice performers through scripted scenarios, coaching for natural, conversational delivery rather than verbatim recitation.
- Build quick scene context for performers (who, where, why) and improvise to fill narrative or dialogue gaps live, keeping sessions flowing naturally.
- Adapt scripted wording for natural phrasing and regional/dialect authenticity as needed.
- Monitor and correct technical audio quality in real time: mic technique, pacing, clarity, and background noise.
- Manage session pacing to meet recording targets without sacrificing performance quality, and maintain organized notes on adjustments and retakes.
- Create a supportive, low-pressure environment for performers, including those with limited prior voice experience.
What We're Looking For
Required
- Native fluency in the required language (with specific dialect), with a strong ear for natural, colloquial phrasing.
- Experience directing, coaching, or producing voice or audio talent (e.g., voice direction, casting direction, audio/podcast production, dubbing/ADR, or theater direction).
- Demonstrated ability to give clear, specific, actionable performance direction.
- Strong working knowledge of basic recording/mic technique (proximity, plosives, room noise, levels).
- Comfortable improvising and adjusting scripted material on the spot.
- Excellent interpersonal skills; able to build rapport quickly with performers of varying experience levels.
Preferred (nice to have, not required)
- Background in improv, theater direction, or acting coaching.
- Experience directing non-professional or first-time voice talent specifically.
- Familiarity with DAWs or recording software (e.g., Pro Tools, Adobe Audition, Reaper) for spot-checking audio quality.
Commitment & Compensation
- Estimated time: Approximately 8 hours calibration, plus supervision across two recording sessions of ~4 hours each per participant
- Work Type - Freelance Remote
Why Join Welo Data?
✨ Limitless Flexibility
Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy.
🌱 Limitless Growth
Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise.
🌍 Limitless Support
Be part of a global contributor community with responsive guidance and support.
💡 Real Impact
Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills.
How to Apply?
Apply now by answering a few quick questions to join our database and become part of our growing community.
About Welo Data
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Location: Quebec City, Canada
Workplace: remote
About the Project
Project Hydrus is a scripted and conversational audio data collection project. The recordings produced help build natural, everyday-sounding synthesized voices for conversational AI products — voices that sound like real people talking, not scripted performances.
As Session Director, you'll lead live recording sessions with Voice Contributors, guiding them through scripted scenarios to produce natural, conversational-quality audio. This hands-on role blends creative direction, coaching, and technical audio judgment — making scripted material sound authentic and unscripted, rather than recited, while keeping sessions moving at a natural pace.
What You'll Do
- Direct voice performers through scripted scenarios, coaching for natural, conversational delivery rather than verbatim recitation.
- Build quick scene context for performers (who, where, why) and improvise to fill narrative or dialogue gaps live, keeping sessions flowing naturally.
- Adapt scripted wording for natural phrasing and regional/dialect authenticity as needed.
- Monitor and correct technical audio quality in real time: mic technique, pacing, clarity, and background noise.
- Manage session pacing to meet recording targets without sacrificing performance quality, and maintain organized notes on adjustments and retakes.
- Create a supportive, low-pressure environment for performers, including those with limited prior voice experience.
What We're Looking For
Required
- Native fluency in the required language (with specific dialect), with a strong ear for natural, colloquial phrasing.
- Experience directing, coaching, or producing voice or audio talent (e.g., voice direction, casting direction, audio/podcast production, dubbing/ADR, or theater direction).
- Demonstrated ability to give clear, specific, actionable performance direction.
- Strong working knowledge of basic recording/mic technique (proximity, plosives, room noise, levels).
- Comfortable improvising and adjusting scripted material on the spot.
- Excellent interpersonal skills; able to build rapport quickly with performers of varying experience levels.
Preferred (nice to have, not required)
- Background in improv, theater direction, or acting coaching.
- Experience directing non-professional or first-time voice talent specifically.
- Familiarity with DAWs or recording software (e.g., Pro Tools, Adobe Audition, Reaper) for spot-checking audio quality.
Commitment & Compensation
- Estimated time: Approximately 8 hours calibration, plus supervision across two recording sessions of ~4 hours each per participant
- Work Type - Freelance Remote
- Rate: $67.00 USD per hour
Why Join Welo Data?
✨ Limitless Flexibility
Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy.
🌱 Limitless Growth
Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise.
🌍 Limitless Support
Be part of a global contributor community with responsive guidance and support.
💡 Real Impact
Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills.
How to Apply?
Apply now by answering a few quick questions to join our database and become part of our growing community.
About Welo Data
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Location: France
Workplace: remote
About the Project
Project Hydrus is a scripted and conversational audio data collection project. The recordings produced help build natural, everyday-sounding synthesized voices for conversational AI products — voices that sound like real people talking, not scripted performances.
As Session Director, you'll lead live recording sessions with Voice Contributors, guiding them through scripted scenarios to produce natural, conversational-quality audio. This hands-on role blends creative direction, coaching, and technical audio judgment — making scripted material sound authentic and unscripted, rather than recited, while keeping sessions moving at a natural pace.
What You'll Do
- Direct voice performers through scripted scenarios, coaching for natural, conversational delivery rather than verbatim recitation.
- Build quick scene context for performers (who, where, why) and improvise to fill narrative or dialogue gaps live, keeping sessions flowing naturally.
- Adapt scripted wording for natural phrasing and regional/dialect authenticity as needed.
- Monitor and correct technical audio quality in real time: mic technique, pacing, clarity, and background noise.
- Manage session pacing to meet recording targets without sacrificing performance quality, and maintain organized notes on adjustments and retakes.
- Create a supportive, low-pressure environment for performers, including those with limited prior voice experience.
What We're Looking For
Required
- Native fluency in the required language (with specific dialect), with a strong ear for natural, colloquial phrasing.
- Experience directing, coaching, or producing voice or audio talent (e.g., voice direction, casting direction, audio/podcast production, dubbing/ADR, or theater direction).
- Demonstrated ability to give clear, specific, actionable performance direction.
- Strong working knowledge of basic recording/mic technique (proximity, plosives, room noise, levels).
- Comfortable improvising and adjusting scripted material on the spot.
- Excellent interpersonal skills; able to build rapport quickly with performers of varying experience levels.
Preferred (nice to have, not required)
- Background in improv, theater direction, or acting coaching.
- Experience directing non-professional or first-time voice talent specifically.
- Familiarity with DAWs or recording software (e.g., Pro Tools, Adobe Audition, Reaper) for spot-checking audio quality.
Commitment & Compensation
- Estimated time: Approximately 8 hours calibration, plus supervision across two recording sessions of ~4 hours each per participant
- Work Type - Freelance Remote
Why Join Welo Data?
✨ Limitless Flexibility
Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy.
🌱 Limitless Growth
Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise.
🌍 Limitless Support
Be part of a global contributor community with responsive guidance and support.
💡 Real Impact
Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills.
How to Apply?
Apply now by answering a few quick questions to join our database and become part of our growing community.
About Welo Data
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Location: Argentina
Workplace: remote
About the Project
Project Hydrus is a scripted and conversational audio data collection project. The recordings produced help build natural, everyday-sounding synthesized voices for conversational AI products — voices that sound like real people talking, not scripted performances.
As Session Director, you'll lead live recording sessions with Voice Contributors, guiding them through scripted scenarios to produce natural, conversational-quality audio. This hands-on role blends creative direction, coaching, and technical audio judgment — making scripted material sound authentic and unscripted, rather than recited, while keeping sessions moving at a natural pace.
What You'll Do
Direct voice performers through scripted scenarios, coaching for natural, conversational delivery rather than verbatim recitation.
Why Join Welo Data?
✨ Limitless Flexibility
Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy.
🌱 Limitless Growth
Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise.
🌍 Limitless Support
Be part of a global contributor community with responsive guidance and support.
💡 Real Impact
Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills.
How to Apply?
Apply now by answering a few quick questions to join our database and become part of our growing community.
About Welo Data
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Location: Peru
Workplace: remote
About the Project
Project Hydrus is a scripted and conversational audio data collection project. The recordings produced help build natural, everyday-sounding synthesized voices for conversational AI products — voices that sound like real people talking, not scripted performances.
As Session Director, you'll lead live recording sessions with Voice Contributors, guiding them through scripted scenarios to produce natural, conversational-quality audio. This hands-on role blends creative direction, coaching, and technical audio judgment — making scripted material sound authentic and unscripted, rather than recited, while keeping sessions moving at a natural pace.
What You'll Do
- Direct voice performers through scripted scenarios, coaching for natural, conversational delivery rather than verbatim recitation.
- Build quick scene context for performers (who, where, why) and improvise to fill narrative or dialogue gaps live, keeping sessions flowing naturally.
- Adapt scripted wording for natural phrasing and regional/dialect authenticity as needed.
- Monitor and correct technical audio quality in real time: mic technique, pacing, clarity, and background noise.
- Manage session pacing to meet recording targets without sacrificing performance quality, and maintain organized notes on adjustments and retakes.
- Create a supportive, low-pressure environment for performers, including those with limited prior voice experience.
What We're Looking For
Required
- Native fluency in the required language (with specific dialect), with a strong ear for natural, colloquial phrasing.
- Experience directing, coaching, or producing voice or audio talent (e.g., voice direction, casting direction, audio/podcast production, dubbing/ADR, or theater direction).
- Demonstrated ability to give clear, specific, actionable performance direction.
- Strong working knowledge of basic recording/mic technique (proximity, plosives, room noise, levels).
- Comfortable improvising and adjusting scripted material on the spot.
- Excellent interpersonal skills; able to build rapport quickly with performers of varying experience levels.
Preferred (nice to have, not required)
- Background in improv, theater direction, or acting coaching.
- Experience directing non-professional or first-time voice talent specifically.
- Familiarity with DAWs or recording software (e.g., Pro Tools, Adobe Audition, Reaper) for spot-checking audio quality.
Commitment & Compensation
- Estimated time: Approximately 8 hours calibration, plus supervision across two recording sessions of ~4 hours each per participant
- Work Type - Freelance Remote
- Rate: $55.00 USD per hour
Why Join Welo Data?
✨ Limitless Flexibility
Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy.
🌱 Limitless Growth
Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise.
🌍 Limitless Support
Be part of a global contributor community with responsive guidance and support.
💡 Real Impact
Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills.
How to Apply?
Apply now by answering a few quick questions to join our database and become part of our growing community.
About Welo Data
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Location: Mexico
Workplace: remote
About the Project
Project Hydrus is a scripted and conversational audio data collection project. The recordings produced help build natural, everyday-sounding synthesized voices for conversational AI products — voices that sound like real people talking, not scripted performances.
As Session Director, you'll lead live recording sessions with Voice Contributors, guiding them through scripted scenarios to produce natural, conversational-quality audio. This hands-on role blends creative direction, coaching, and technical audio judgment — making scripted material sound authentic and unscripted, rather than recited, while keeping sessions moving at a natural pace.
What You'll Do
Direct voice performers through scripted scenarios, coaching for natural, conversational delivery rather than verbatim recitation.
Why Join Welo Data?
✨ Limitless Flexibility
Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy.
🌱 Limitless Growth
Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise.
🌍 Limitless Support
Be part of a global contributor community with responsive guidance and support.
💡 Real Impact
Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills.
How to Apply?
Apply now by answering a few quick questions to join our database and become part of our growing community.
About Welo Data
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Location: United States
Workplace: remote
About the Project
Project Hydrus is a scripted and conversational audio data collection project. The recordings produced help build natural, everyday-sounding synthesized voices for conversational AI products — voices that sound like real people talking, not scripted performances.
As Session Director, you'll lead live recording sessions with Voice Contributors, guiding them through scripted scenarios to produce natural, conversational-quality audio. This hands-on role blends creative direction, coaching, and technical audio judgment — making scripted material sound authentic and unscripted, rather than recited, while keeping sessions moving at a natural pace.
What You'll Do
- Direct voice performers through scripted scenarios, coaching for natural, conversational delivery rather than verbatim recitation.
- Build quick scene context for performers (who, where, why) and improvise to fill narrative or dialogue gaps live, keeping sessions flowing naturally.
- Adapt scripted wording for natural phrasing and regional/dialect authenticity as needed.
- Monitor and correct technical audio quality in real time: mic technique, pacing, clarity, and background noise.
- Manage session pacing to meet recording targets without sacrificing performance quality, and maintain organized notes on adjustments and retakes.
- Create a supportive, low-pressure environment for performers, including those with limited prior voice experience.
What We're Looking For
Required
- Native fluency in the required language (with specific dialect), with a strong ear for natural, colloquial phrasing.
- Experience directing, coaching, or producing voice or audio talent (e.g., voice direction, casting direction, audio/podcast production, dubbing/ADR, or theater direction).
- Demonstrated ability to give clear, specific, actionable performance direction.
- Strong working knowledge of basic recording/mic technique (proximity, plosives, room noise, levels).
- Comfortable improvising and adjusting scripted material on the spot.
- Excellent interpersonal skills; able to build rapport quickly with performers of varying experience levels.
Preferred (nice to have, not required)
- Background in improv, theater direction, or acting coaching.
- Experience directing non-professional or first-time voice talent specifically.
- Familiarity with DAWs or recording software (e.g., Pro Tools, Adobe Audition, Reaper) for spot-checking audio quality.
Commitment & Compensation
- Estimated time: Approximately 8 hours calibration, plus supervision across two recording sessions of ~4 hours each per participant
- Work Type - Freelance Remote
Why Join Welo Data?
✨ Limitless Flexibility
Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy.
🌱 Limitless Growth
Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise.
🌍 Limitless Support
Be part of a global contributor community with responsive guidance and support.
💡 Real Impact
Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills.
How to Apply?
Apply now by answering a few quick questions to join our database and become part of our growing community.
About Welo Data
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
JКомпания не указана
Управление вакансиями скоро появится
Скрытые компании и отметки о просмотре ещё не подключены.
Негізгі міндеттері:
• Модульдер мен компоненттердің архитектурасын жобалау;
• Жоғары өнімді және масштабталатын пайдаланушы интерфейстерін әзірлеу;
• Code review жүргізу және Junior/Middle деңгейіндегі әзірлеушілерге тәлімгерлік ету;
• Frontend-ті жинақтау және деплой жасау процестерін оңтайландыру;
• Ретроспективаларға қатысу және процестерді жетілдіру бойынша ұсыныстар енгізу.
Негізгі талаптар:
• Жоғары білім (IT немесе сабақтас бағыттар бойынша);
• Angular-пен жұмыс тәжірибесі 3 жылдан жоғары;
• Angular бойынша сараптамалық білім (custom directives, advanced RxJS);
• CI/CD (GitLab CI, Jenkins) және e2e-тестілеумен жұмыс тәжірибесі;
• Frontend архитектурасын түсіну;
• Agile-командаларда жұмыс тәжірибесі және әзірлеу процестерін жетілдіруге ықпал ету;
• Жеке қасиеттері: аналитикалық ойлау, тәлімгерлік қабілет, икемділік.
Location: Boston, MA
Workplace: OnSite
ABOUT US
At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale.
With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.
Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater.
ABOUT THE TEAM
The LangSmith team owns and builds LangChain's core platform for observability, evaluation, and production reliability of AI systems. From tracing and annotation to run rules, evaluations, and beyond, this team owns LangSmith end-to-end. If you want to define what great AI observability looks like at production scale, this is where that work gets done.
ABOUT THE ROLE
We’re looking for an Engineering Manager to lead the team building LangSmith, our observability and evaluation platform for LLM applications. You’ll define the technical direction, grow and mentor a world-class engineering team, and partner with product and design to deliver features that help developers build and deploy trustworthy AI systems with confidence.
WHAT YOU'LL DO
- Build, mentor, and grow a high-performing team of engineers, fostering collaboration, ownership, and accountability
- Strengthen LangChain’s engineering culture through mentorship, high-quality code, and technical excellence
- Shape long-term technical direction and ensure scalability and reliability of LangSmith AI Observability Platform
- Partner with product and design teams to define scope, sequence, and success criteria for key initiatives
- Maintain a high bar for technical excellence while making sure the team moves with urgency and focus
- Lead by example in writing clean, maintainable, and well-tested code in Go/Python and Typescript
- Engage directly with customers to understand their needs and translate them into actionable product improvements
WHAT YOU'LL BRING
- Experience managing or tech-leading teams delivering complex full-stack products
- Strong technical background in Go/Python and React/Typescript
- Solid understanding of databases (Postgres, Redis and ClickHouse)
- Proven ability to design high throughput data-intensive systems
- Bias towards shipping quickly and learning from customers
- Strong communication skills—able to collaborate with internal stakeholders and engage directly with customers
- Bonus: Experience building AI/LLM-powered applications, developer tools, or observability platforms
Annual salary range: $220,000- $270,000
Compensation Philosophy:
We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks.
We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations.
BENEFITS
Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.
Location: Singapore (We support relocation & visas!)
Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this market has been heavily underserved by technology and deserves better. Workstream has been purpose-built for the hourly workforce from day one so that these businesses and their employees can thrive.
Our customers include leading brands from multiple sectors, including Burger King, Carl's Jr./Hardee's, IHOP, KFC, and Culvers. We are a high growth series B company and quickly expanding our product portfolio to deliver on our vision. We are backed by legendary VCs and industry experts like Founders Fund, BOND, and Coatue.
Grow With Us
We are looking for a
Senior Product Marketing manager
to join our team.
This is a high-leverage PMM seat, owning positioning, launches, and sales enablement for a platform that is expanding from hiring into payroll, HR, and AI products. You report directly into revenue leadership, and will lead a team of 3 managing Product Marketing & owning the brand, with a lot of growth potential to take on more scope in the future!
We are looking for leaders that thrive in a fast-paced environment. Ex-founders thrive here.
Location & Relocation
This is a
4 to 5-days-per-week in-office role at our San Francisco office
. We believe being together is important for building quickly, collaborating closely, and shaping the next chapter of Workstream
We support relocation and visa sponsorship
for the right candidate
Day In The Life
Positioning & Messaging:
Own how we describe Workstream on the website, in decks, and in the first 30 seconds of every sales call. Test our biggest narrative question, restaurant-first vs. the broader frontline-workforce story, with real experiments, not opinions.
Product Launches:
Run end-to-end GTM launches for new products, including our AI assistant for frontline teams and our expanding payroll suite: messaging, launch plan, pricing & packaging input, and post-launch iteration.
Sales Enablement:
Build the battlecards, competitive teardowns, ROI narratives, and customer proof that make AEs win. Listen to calls weekly and update the message when the market talks back.
Customer Proof & Content:
Turn customers like the biggest QSR brands in America into case studies, video stories, and webinars, working hand-in-hand with our content and design team.
Ship With AI:
Use AI agents across research, drafting, and analysis to move at a pace that would have taken a full team a year ago. We expect it, and we'll teach you what we know.
Who You Are
3-10 years in product marketing or a mix of PMM and growth/content roles, ideally in B2B SaaS; what you've shipped matters more to us than your title history.
Founder energy:
you've built something from scratch (a company, a product, a channel) and you bias hard toward action; former founders welcome!
Commercially minded:
you judge your own work by pipeline influenced and deals won, and you actually enjoy talking to sales.
AI-native:
AI tools are already part of how you work every day.
Hungry:
you want more scope than your years "should" allow, and you're willing to earn it in person, in SF, with a team that works hard.
Experience with SMB buyers, hourly/frontline workforces, HR tech, or payroll is a strong plus.
Travel & Location
Based in (or relocating to) San Francisco; in-office at least 4 days per week
Occasional travel for customer visits, conferences, and team events
What We Offer
Pay directly to your bank account (once a month)
Health Insurance
Flexible PTO
Follow Singapore Holidays
Company-issued device will be provided
Workstream will process CPF and taxes
Experience using AI to automate repetitive and data processing tasks.
Prior exposure to code-based automation workflows (e.g. Python scripts, APIs, Zapier, or similar) - no need to know how to code!
Familiarity with common marketing tools (e.g. HubSpot, Google Analytics, Google Tag Manager)
Know More About Workstream
https://www.workstream.us/blog/funding-series-b
https://techcrunch.com/2021/08/26/workstreams-text-based-recruitment-tool-gets-a-48m-bet-from-bond-and-beyond/
https://techbuzz.news/buzzworthy-august-27-2021/
Additional Information
Workstream provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.
We are committed to the full inclusion of all qualified individuals.
Location: Singapore (We support relocation & visas!)
Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this market has been heavily underserved by technology and deserves better. Workstream has been purpose-built for the hourly workforce from day one so that these businesses and their employees can thrive.
Our customers include leading brands from multiple sectors, including Burger King, Carl's Jr./Hardee's, IHOP, KFC, and Culvers. We are a high growth series B company and quickly expanding our product portfolio to deliver on our vision. We are backed by legendary VCs and industry experts like Founders Fund, BOND, and Coatue.
Grow With Us
We are looking for a
Head of Brand & Product Marketing
to join our team. This is building, not maintaining. You will own how Workstream is positioned, launched, and remembered, at the moment we expand from a vertical SaaS leader into an AI-native platform for the entire frontline workforce. You'll run product marketing, brand, content, and design as one team, report directly to our revenue leadership, and see your work show up in the pipeline within weeks, not quarters.
We are looking for leaders that thrive in a fast-paced environment. Ex-founders thrive here.
Location & Relocation
This is a
4 to 5-days-per-week in-office role at our San Francisco office
. We believe being together is important for building quickly, collaborating closely, and shaping the next chapter of Workstream
We support relocation and visa sponsorship
for the right candidate
Day In The Life
Positioning & Narrative:
Own Workstream's positioning and messaging end to end, including the biggest open strategic question we have: leading with our restaurant dominance vs. the broader frontline-workforce story. You'll test it, not debate it.
Product Launches:
Run GTM launches for a portfolio that now ships AI products (like our AI assistant for frontline teams) alongside hiring, HR, and payroll. Messaging, pricing & packaging input, launch plans, and the enablement that makes Sales dangerous in the first week.
Brand & Content:
Lead our content and design team across the website, case studies, video, webinars, and social. Raise the bar on everything customer-facing, and use AI to produce at a pace a team twice our size couldn't match a year ago.
Working with Sales:
Arm AEs and partnerships with narratives, competitive teardowns, ROI stories, and customer proof. Sit in on deals. Talk to lost prospects. Change the message when the market tells you to.
Team Leadership:
Manage and grow a small, high-output team of product marketers, content marketers, and designers, and be the strongest IC on it when it matters.
Who You Are
Slope over pedigree:
5+ years in B2B marketing with real product marketing depth, but we care more about what you've shipped and how fast you're improving than the logos on your resume.
Management experience
: You have built and led hungry and dynamic marketing teams in the past.
Founder energy:
you've started something (a company, a category, a function from zero) and you default to action; former founders welcome!
A writer and an operator:
you produce sharp positioning yourself, and you build systems so the team produces it without you.
AI-native:
you already use AI agents across your daily work and you'll push the team to do the same.
Commercially ruthless:
you measure marketing in pipeline and revenue, not impressions.
Hungry:
you outwork the market and you want the scope of a VP role earlier than a big company would ever give it to you.
Experience with SMB buyers, hourly/frontline workforces, HR tech, or payroll is a strong plus.
Travel & Location
Willing to relocate to San Francisco; in-office at least 4 days per week
Occasional travel for customer visits, conferences, and team events
What We Offer
Pay directly to your bank account (once a month)
Health Insurance
Flexible PTO
Follow Singapore Holidays
Company-issued device will be provided
Workstream will process CPF and taxes
Experience using AI to automate repetitive and data processing tasks.
Prior exposure to code-based automation workflows (e.g. Python scripts, APIs, Zapier, or similar) - no need to know how to code!
Familiarity with common marketing tools (e.g. HubSpot, Google Analytics, Google Tag Manager)
Know More About Workstream
https://www.workstream.us/blog/funding-series-b
https://techcrunch.com/2021/08/26/workstreams-text-based-recruitment-tool-gets-a-48m-bet-from-bond-and-beyond/
https://techbuzz.news/buzzworthy-august-27-2021/
Additional Information
Workstream provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.
We are committed to the full inclusion of all qualified individuals.
Budgets by Tammy is looking for U.S.-based independent referral partners to help introduce people to their personalized monthly budgeting service. This is a flexible, commission-only independent contractor opportunity with no set hours, schedules, or sales quotas.
Compensation:
— Earn 25% commission ($24.75) for every completed $99 personalized budget referral.
— No guaranteed salary or hourly pay; earnings are based solely on successful referrals.
How it works:
— Follow @BudgetsByTammy on TikTok.
— Receive a unique referral code and a personalized promotional graphic.
— Share Budgets by Tammy with your social media audience, friends, family, or contacts.
— Earn commission when someone purchases a $99 personalized monthly budget using your referral code.
Who this may be great for:
— People who enjoy social media, budgeting, personal finance, saving money, sharing helpful resources, or connecting people with useful services.
— No need to be a financial professional or have a large social media following.
Referral Partner Requirements:
— Must be based in the United States.
— Must follow @BudgetsByTammy on TikTok.
— Must accurately represent Budgets by Tammy and the services offered.
— Must clearly disclose the commission relationship when promoting, stating that you earn a commission from qualifying purchases.
— No set hours or quotas; work on your own schedule.
To apply, use the provided link to get started.
Location: Warsaw, Mazowieckie, Poland
X-FLOW
is a mobile game development company established in 2018. We gained recognition after the release of
Happy Color
, the most popular digital coloring book and one of the most successful ad-driven mobile apps in the world.
We are currently looking for a
Senior Backend Engineer (Go)
for our flagship project, Happy Color.
Key Responsibilities:
• Design and develop microservices in Go (REST/gRPC), public and internal APIs.
• Integrate with external services, develop contracts.
• Optimize performance, profiling, reduce latency, and scale systems.
• Design database schemas, perform migrations, indexing, and query optimization.
• Work with PostgreSQL/MySQL, Redis, Kafka/NATS and event-driven integrations.
• Implement and maintain CI/CD, cloud infrastructure (AWS) with Docker/Kubernetes.
• Ensure quality: writing tests (unit/integration/e2e), code reviews, automation of checks.
• Ensure observability and reliability: logging, metrics, alerting, tracing.
• Participate in architectural design, RFCs/ADRs.
Requirements:
• 3+ years of commercial development experience, including 3+ years with Golang.
• Proficient in Go: context handling, concurrency (goroutines/channels), profiling (pprof), gRPC/REST, generics, modularity.
• Strong understanding of backend architecture, API design, microservices, and distributed systems.
• Databases: PostgreSQL/MySQL, Redis; design, indexing, transactions.
• Queues/Buses: Kafka/NATS — experience in designing event-driven integrations.
• Experience with search technologies such as OpenSearch would be a plus.
• CI/CD: GitLab CI, feature flags, migrations, blue-green/rolling deployments.
• Testing: Go testing/testify, integration/e2e.
• Security: OAuth2, JWT.
• Understanding of DDD principles, SOLID, 12-factor methodology, observability (Prometheus/Grafana, OpenTelemetry).
• Russian - C1/higher, English - B1.
Nice to have:
• Experience with Python and/or PHP.
• Experience with TypeScript, JavaScript and React.
• Experience with OpenSearch.
• Data architecture: CQRS/Event Sourcing, idempotency, deduplication.
• Experience building BFFs, WebSockets.
• Feature flags, experiments/A-B testing, product metrics.
Technology Stack (Primary):
• Backend: Go, gRPC/REST, PostgreSQL, Redis, Kafka.
• DevOps: GitLab CI, Docker, nice to have: Kubernetes, AWS, Helm.
• Observability: Prometheus, Grafana, Loki, OpenTelemetry, Sentry.
• Search: OpenSearch.
What We Offer:
• Competitive salary and benefits package.
• Opportunity to work with a talented and passionate team in a creative and dynamic environment.
• Flexible working hours and remote/office work options.
• Career growth and professional development opportunities.
• A fun and inclusive company culture that celebrates diversity and creativity.
Join us and let’s create great content together!
When you apply for this role, we process your personal data in accordance with our Candidate Privacy Notice
(
https://xflowgames.com/candidate-privacy-notice)
.
Location: Poland; Georgia; Serbia; Bulgaria; Armenia
We build cloud CPaaS/CCaaS infrastructure - the routing, messaging and real-time layer that contact centres run on. High traffic, event-driven services, and a UI that has to stay correct while thousands of live conversations move through it.
We're hiring a senior engineer for a team where AI agents are part of the normal development loop, not a pilot. You'll own features end-to-end across a Go backend and a React/TypeScript frontend, and you'll be accountable for everything you ship — including the parts an agent wrote.
This is not a prompt-engineering role. It's a senior engineering role where AI-assisted delivery is the default working method.
Requirements
What will you do at MMDSmart?
Own features end-to-end across Go backend and React/TypeScript frontend;
Design and develop solutions for high-load and distributed production systems;
Use AI coding agents as an integral part of your everyday development workflow;
Guide AI agents, review and verify their output, and take ownership of the final result;
Build and evolve backend services, APIs, frontend functionality, and external integrations;
Investigate complex production issues and drive them to resolution;
Contribute to architecture decisions, technical discussions, and system improvements;
Help improve our codebase and development practices to make AI-assisted engineering more effective.
You are a perfect match if you have:
5+ years of professional software engineering experience and strong Senior-level engineering fundamentals;
Strong hands-on production experience with Go - 4 years of experience;
Practical experience with React and/or TypeScript; you don’t need to be a frontend expert, but you should be comfortable working with frontend code;
Hands-on experience with high-load and distributed production systems;
Experience designing, building, and debugging production services and APIs;
Hands-on experience with AI coding tools such as Claude Code, Cursor, Windsurf, Copilot, or similar - beyond simple autocomplete;
Ability to use AI to work effectively across different parts of the stack while critically reviewing and verifying its output;
Strong engineering judgement, ownership, and ability to make technical decisions independently.
Our Tech Stack:
Backend: Go, microservices, REST APIs, GraphQL
Frontend: React, TypeScript, Zustand / Redux Toolkit, WebSocket / SSE
Event-driven: Kafka, NATS / JetStream, RabbitMQ, event-driven architecture
Data: PostgreSQL, Redis, MongoDB
Infrastructure: GCP, Kubernetes, Docker, CI/CD, Infrastructure as Code
Observability & Performance: structured logging, metrics, tracing, profiling, high-load and concurrency tooling
AI Development: Claude Code, Cursor, Windsurf, Copilot and other agentic development tools
Domain: CPaaS / CCaaS, messaging, voice, real-time communication, external provider integrations
Will be a plus:
CCaaS / CPaaS / telecom background: contact-centre routing, ACD, omnichannel messaging.
Voice stack: WebRTC, SIP, media servers, or CPaaS APIs
API gateway and microservices integration; GraphQL federation.
Kubernetes, Docker, CI/CD ownership, infrastructure-as-code.
Polyglot persistence: Redis for caching and ephemeral state, PostgreSQL where a document model is the wrong fit; plus the judgement to tell the difference. MongoDB Atlas or self-managed cluster operations.
Internal tooling, evals or automation built on LLM APIs.
Open-source contributions, especially in Go.
What you get:
An AI-first engineering environment where AI is part of real production development;
The opportunity to use AI to work across the full stack and expand beyond your primary expertise;
Work on high-load communication products with real business impact;
A team where Senior Engineers influence technical decisions and architecture;
Remote work.
Benefits
Why do talents choose and stay at MMDSmart?
Embrace the opportunity to work in a company that cares about:
Your Wellness:
Access to mental health programs, comprehensive medical insurance, and a sports card*.
Your Happiness:
Enjoy the company of cool teammates, a friendly atmosphere, a strong mentorship, and a variety of bonuses & corporate gifts.
Your Development:
Benefit from free educational events & courses, and English classes with native speakers.
Your Career:
Focus on your professional development in a supportive environment.
Work-Life Balance:
Choose your working format - remote, office-based, or hybrid and engage in team-building activities.
Think this role's got your name on it? Go ahead and apply, we'd love to see what you've got!
Equal-Opportunity Employment
We are an equal opportunity employer committed to creating a diverse and inclusive work environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.
*Medical Insurance and Sport Card perks are available for employees located in Bulgaria.
Задачи:
— Подготовка деплой-пакетов и конфигураций, создание и поддержка Helm-чартов, Kubernetes-манифестов, стандартизация конфигураций; управление секретами, сертификатами и переменными окружения
— Управление инфраструктурой как код (IaC): разработка и поддержка Terraform-модулей, Ansible-ролей для развертывания и настройки инфраструктуры (bare-metal, cloud, виртуализация)
— Администрирование платформ оркестрации: установка, настройка и эксплуатация Kubernetes-кластеров (в том числе управление узлами, сетевыми политиками, storage, обновлениями)
— Настройка наблюдаемости (observability): реализация сбора метрик, логирования и трассировки; настройка мониторинга (Prometheus/Victoria Metrics), алертинга (Alertmanager), визуализации (Grafana); обеспечение выполнения SLO/SLA
— Обеспечение безопасности инфраструктуры: контроль доступа (RBAC, network policies), управление секретами, настройка политик безопасности подов, сканирование уязвимостей образов и конфигураций; участие в DevSecOps-практиках
— Подготовка эксплуатационной документации и реагирование на инциденты: разработка runbook, процедур восстановления, участие в устранении инцидентов и постмортемах; поддержка готовности сервисов к продуктивной эксплуатации
— Оптимизация ресурсов и надежности: мониторинг утилизации ресурсов, планирование емкости, оптимизация затрат (cost management) для облачных и on-prem решений; поддержка регулярных релизов и обновлений
— Взаимодействие с командами разработки: консультирование по DevOps-практикам, совместная работа над архитектурой приложений, внедрение стандартов и инструментов, повышение культуры автоматизации
— Участие в архитектурных решениях и планировании: оценка новых технологий, проектирование инфраструктуры, участие в формировании требований к доступности и производительности, декомпозиция технических задач
Требования:
— Опыт разработки и поддержки CI/CD пайплайнов (Jenkins, GitLab CI)
— Уверенное владение Kubernetes: развертывание, настройка, управление кластерами, работа с Helm, операторами, сетевыми политиками
— Практический опыт с Infrastructure as Code (Terraform, Ansible) — автоматизация развертывания инфраструктуры и конфигураций
— Знание принципов observability: настройка Prometheus/Victoria Metrics, Grafana, Loki/ELK, Alertmanager, трассировка
— Опыт работы с системами управления секретами (Hashicorp Vault, Kubernetes Secrets, внешние хранилища) и сертификатами
— Понимание подходов DevSecOps: управление доступом, network policies, сканирование уязвимостей (SAST/DAST), работа с инструментами безопасности
— Знание Git, работа с ветвлением, стратегии управления релизами
Желательные навыки:
— Опыт внедрения прогрессивных стратегий доставки (canary, blue-green, A/B) с использованием Argo Rollouts, Istio, Flagger
— Знание SQL/NoSQL баз данных (PostgreSQL, MongoDB) на уровне администрирования и оптимизации
— Опыт работы с Kafka (настройка, мониторинг, управление топиками)
— Навыки написания runbook и документации, участие в постмортемах
Обязанности:
• Разработка и поддержка высоконагруженных пользовательских интерфейсов на Angular и TypeScript;
• Проектирование и реализация микрофронтендной архитектуры (Module Federation, Web Components и т.п.);
• Интеграция с микросервисным бэкендом (REST/gRPC/WebSocket), работа с API-контрактами;
• Участие в проектировании архитектуры фронтенд-приложений и технических решений;
• Менторство и помощь младшим разработчикам;
• Участие в планировании, оценке задач, декомпозиции;
• Проведение code review, соблюдение стандартов кодирования;
• Обеспечение качества, производительности и отказоустойчивости интерфейсов.
Требования:
• Опыт работы с JavaScript от 5 лет.;
• Опыт работы с Angular и TypeScript;
• Опыт написания тестов;
• Опыт работы с микросервисной и микрофронтендной архитектурой;
• Опыт настройки CI, nginx будет плюсом.
Условия:
• Официальное трудоустройство по ТК РФ в аккредитованную IT-компанию;
• Полностью белую заработную плату;
• ДМС после испытательного срока;
• Корпоративное обучение, возможности профессионального развития и карьерного роста;
• Программу корпоративных скидок и привилегий (Best Benefits);
• Совместные активности, мероприятия и многое другое.
seniorГеография найма не уточнена
УдалённоGermany
УдалённоQuebec City, Canada
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.