Location: Hong Kong, Hong Kong SAR; Singapore, Singapore
OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa
About OKX
At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles:
We Before Me
,
Do the Right Thing
, and
Get Things Done
. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more.
About The Team
The DEX Token Markets team at OKX Web3 builds real-time market tracking and analysis tools across 40+ chains and hundreds of thousands of trading pairs — charts, trade feeds, watchlists, alerts, and screeners trusted by millions of traders navigating DeFi, including the fast-moving meme coin markets driving much of today's on-chain volume.
What You'll Be Doing
Build and maintain the market tracking platform, including systems tuned for meme coin-style volume spikes and liquidity swings.
Develop high-throughput, low-latency backend systems that keep data accurate and reliable under bursty load.
Troubleshoot issues to ensure service stability and quality.
Ship features on time with clean, well-tested, maintainable code.
Collaborate with product and engineering to keep integrations running smoothly.
What We Look For In You
Bachelor's/Master's in CS, Software Engineering, or related (or strong STEM background).
3-5+ years building high-performance systems in Java — strong grasp of JVM, IO, multithreading, concurrency, networking.
Solid MySQL experience (transactions, indexing, SQL optimization) and familiarity with caching/message queue middleware.
Strong command of data structures, algorithms, design patterns.
Clear logic, strong communication, thrives in fast-paced environments.
Hands-on meme coin trading experience — an active trader/degen who understands the volatility, liquidity dynamics, and speed that define this market, bringing real product intuition to the team.
Nice to Haves
Distributed systems experience — consistency, high availability, fault tolerance, horizontal scalability.
Experience with real-time on-chain data systems: DEX pools, token launches, liquidity tracking.
Working proficiency in English for global collaboration.
Perks & Benefits
Competitive total compensation package
L&D programs and Education subsidy for employees' growth and development
Various team building programs and company events
Wellness and meal allowances
Comprehensive healthcare schemes for employees and dependants
More that we love to tell you along the process!
Notice:
All official
OKX
vacancies are published on this website.
While roles may appear on selected third-party platforms from time to time, information on other sites may be inaccurate or outdated.
If in doubt, please apply directly through our official careers website.
Information collected and processed as part of the recruitment process of any job application you choose to submit is subject to
OKX
's
Candidate Privacy Notice
.
seniorHong Kong, Hong Kong SAR; Singapore, Singapore
Location: New York
ABOUT US:
AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL.
Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
Our customers include category-defining companies like Ramp https://modal.com/blog/how-ramp-built-a-full-context-background-coding-agent-on-modal, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.
We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.
Our team includes creators of popular open-source projects (e.g.,Seaborn https://github.com/mwaskom/seaborn,Luigi https://github.com/spotify/luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.
THE ROLE:
We’re looking for business operations managers to join the team. You’ll work closely with folks across marketing, sales, operations, and finance on a variety of initiatives to help scale the business in our next phase of growth. You’ll be a generalist who gets in the weeds on all the business and operational aspects of a high-growth startup.
WHAT YOU’LL WORK ON:
- Drive in-depth quantitative analyses to inform our pricing and packaging strategy
- Help spin up our deal desk and streamline enterprise deals
- Support the exec team on various finance functions, from investor relations to large cloud vendor negotiations to identifying cost optimization opportunities
- Implement new tools and processes to enable the GTM org to grow rapidly
- Get creative on a spectrum of ad hoc projects like securing new office space in Manhattan
YOU MAY BE A FIT IF:
- You have 5+ years of experience working in some kind of business function (e.g., banking, consulting, startup)
- You have some exposure to tech and coding (in order to understand our product and customer, work with analytical tools, and build out custom tooling)
- You’re analytical, organized, and detail-oriented, and you hold your output to a high bar of excellence
- You’re eager to learn about a variety of different business functions and juggle many projects at once
- You’re excited about working in person in NYC
Location: Argentina; Brazil; Colombia
Workplace: Remote
Solvd Inc. is a rapidly growing AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence. We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business outcomes.
Following the acquisition of Tooploox, a premier AI and product development company, Solvd now offers true end-to-end delivery—from strategic advisory and solution design to custom AI development and enterprise-scale implementation. Our capability centers combine deep technical expertise, proven delivery methodologies, and sector-specific knowledge to address complex business challenges quickly and effectively.
Solvd is seeking a Senior AI Engineer to join our team. This role will be essential in the winning of opportunities for the company, primarily focusing on supporting presales process and opportunities discovery with existing clients.
ABOUT THE PROJECT
Our client, a global e-commerce leader with a large-scale, service-oriented technology estate and complex cloud infrastructure, is seeking to elevate their customer support technology stack by introducing Agentic AI to streamline case workflow resolutions and by implementing an integrated platform to replace the fragmented set of solutions currently used by support agents.
Ultimately, our client aims to deliver a more personalized and satisfying support experience to end users - improving CSAT, reducing resolution time, and enhancing service quality across all channels.
We are developing a customer support research and resolution platform. The platform will include:
- data layer, provide a federated GraphQL interface that unifies access to multiple backend services, enabling low-latency, real-time data retrieval and transactional operations to support AI-driven workflows.
- agentic layer, supporting AI-assisted support workflows with human in the loop for validation and confirmation purposes
- research capability, allowing end users to intervene when AI is stuck or gives suggestions with low confidence - this capability should enable users to perform additional research, data lookups and actions execution using natural language prompts leveraging LLM and tools (lookups and mutating operations exposed via MCP servers)
The role will focus on designing, building and optimizing this agentic research flows for research capability. This is a multi-team, collaborative initiative that requires close coordination with other delivery teams, adherence to high engineering standards and a strong focus on integration and architectural alignment.
WHAT YOU’LL DO
- Design and implement AI-powered features: integrate LLM and build AI agents.
- Design and implement ent-to-end (frontend and backend) non-AI features, services and business logic that make the solution complete.
- Build and maintain MCP servers to expose domain data and capabilities as tools for AI agents.
- Implement RAG workflows to ground LLM responses in factual data using embeddings, chunking and vector databases.
- Instrument and optimize OpenAI integrations for cost, latency, and accuracy in production environments.
- Collaborate with product, design and architecture teams to craft exceptional user experiences built on AI.
- Participate in technical design reviews, shaping architectural decisions and engineering standards.
WHO ARE YOU
- You see engineering as an art of solving problems, using languages and frameworks as tools - not boundaries or limiting factors.
- You stay ahead of the curve, continuously tracking the latest developments in Generative AI and excited to be part of how it transforms digital solutions are how they are built.
- You know best practices of building AI agents leveraging OpenAI ecosystem (OpenAI Agents SDK specifically).
- You have 6+ years of server-side engineering experience, designing and building enterprise-scale software systems.
- You have a strong understanding of distributed systems design patterns.
- You have strong knowledge of different types of data stores (relational, document, vector, key-value) and understand when to use each effectively.
- You are fluent in React, Node.js, TypeScript and confident integrating OpenAI models in real-world applications.
- You are fluent in at least one non-JS programming language (Java is a strong advantage).
- You are able to express your thoughts and ideas clearly to different audiences, including non-technical stakeholders, bridging business and technical perspectives.
- You thrive in environments where AI isn’t a side feature but a core building block.
- You can take ownership of and drive feature implementation end-to-end, coordinating the work of multiple team members when needed.
- You have a strong understanding of Agile delivery methodologies and understand the importance of expectations management, estimations and commitments.
WHAT YOU BRING
- 6+ years of professional backend engineering experience, 3+ years with TypeScript/Node.js.
- 9+ months of commercial experience building AI features using OpenAI ecosystem.
- Hands-on expertise with the OpenAI Agents SDK - building and orchestrating AI agents with capabilities such as tool/function calling, assistants, streaming interactions, and stateful workflows.
- Experience designing and implementing MCP servers to integrate external capabilities with LLMs.
- Proven ability to design structured prompt architectures with evals, guardrails and observability.
- Familiarity with RAG: embeddings, chunking, vector search, retrieval orchestration.
- Strong fundamentals in building secure, performant, production-grade APIs and backend systems.
- Experience with CI/CD, testing, monitoring, and cloud infrastructure.
ADDITIONAL SKILLS
- Understanding concepts of semantic search is a strong advantage.
- Experience playing a role of team leaders is a strong advantage.
- Exposure to other LLM providers (e.g., Anthropic, Mistral AI, Hugging Face) is a strong advantage.
- Experience with streaming UIs, conversational UX, and SSE/WebSockets.
- Knowledge of prompt injection defenses and responsible AI practices.
TECH STACK
This platform is a green-field development.
- Core: TypeScript, Node.js, React/Next.js, Java
- AI: OpenAI API, MCP servers, OpenAI Agents SDK
- APIs: GraphQL, REST APIs, SOAP (downstream services - you won’t have to deal with them much)
- Data storages: Postgres + pgvector, Pinecone (or other vector DBs), RAG pipelines
- Infra: proprietary managed cloud (you won’t have to deal with any infra-level aspects
When you join Solvd, you'll…
- Shape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation.
- Be part of a global team with equal opportunities for collaboration across continents and cultures.
- Thrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards.
Ready to make an impact?
If you're excited to build things that matter, champion responsible AI, and grow with some of the industry’s sharpest minds. Apply today and let’s innovate together.
Solvd is an equal opportunity employer.
Location: Foster City, CA
Workplace: Hybrid
Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation.
About the role:
Help power the development of Replit Agent as an engineer in the Replit Cloud organization. The Replit Cloud team builds Replit’s first party cloud infrastructure so users can build, scale, and succeed entirely on Replit. They manage databases, application storage, app publishing and hosting, development/production environment splitting, custom domains, and more. By having a set of first party services that integrate seamlessly, you will power one of Replit’s key product differentiators.
You will:
- Work closely with designers and product managers, to quickly iterate on Replit Cloud to continually grow and improve the product.
- Drive full-stack feature development from conception to deployment, taking ownership of key product initiatives.
- Contribute to architectural decisions that shape the future of our product.
- Ship product and build infrastructure as a true full stack builder using: TypeScript, React, CSS, Postgres, Go, and Terraform.
Examples of what you could do:
- Leverage our unique cloud infrastructure to build differentiated full product experiences, helping non-technical or semi-technical users remove roadblocks to success.
- Leverage AI agents to proactively optimize or suggest app improvements on latency, reliability, SEO, and more.
- Be part of engineering leadership, steering teams towards the highest impact work and supporting initiatives across the company.
Required skills and experience:
- Bachelor’s degree in Computer Science or related field, OR equivalent real-world experience in engineering roles.
- Comfortable building with our tech stack: TypeScript, React, Go
PREFERRED QUALIFICATIONS
- Experience building user facing platform as a service products.
- Experience with AI/agentic systems.
- Previous experience at a high-growth startup.
Bonus Points:
- Open source project contributions.
WHAT WE VALUE:
- Problem-solving mindset: Ability to approach complex operational challenges systematically and devise effective solutions
- Self-directed and autonomous: Capable of working independently while collaborating effectively with cross-functional teams
- Strong communication skills: Ability to explain complex technical concepts to both technical and non-technical audiences
- Continuous learning: Passion for staying current with industry best practices and new technologies
- Focus on automation: Strong belief in automating repetitive tasks and building self-healing systems
This is a full-time role that can be held from our Foster City, CA office. The role has an in-office requirement of Monday, Wednesday, and Friday.
Full-Time Employee Benefits Include:
💰 Competitive Salary & Equity
💹 401(k) Program with a 4% match (US Only)
⚕️ Health, Dental, Vision and Life Insurance
🩼 Short Term and Long Term Disability
🚼 Paid Parental, Medical, Caregiver Leave
🏝 Flexible Time Off (FTO) + Holidays
🚗 Commuter Benefits (In-Office & US Only)
📱 Monthly Wellness Stipend
🧑💻 Autonomous Work Environment
🖥 In Office Set-Up Reimbursement (In-Office Only)
🚀 Quarterly Team Gatherings
☕ In Office Amenities (In-Office Only)
Want to learn more about what we are up to?
- Self-driving Company https://replit.com/blog/self-driving-company
- Replit Agent at Scale https://replit.com/blog/evaluating-and-improving-agent-at-scale
- AI Adoption https://replit.com/blog/ai-adoption
- Build Open-Source Apps https://replit.com/build/open-source-app-builder
Interviewing + Culture at Replit
- Operating Principles https://blog.replit.com/operating-principles
- Reasons not to work at Replit https://blog.replit.com/reasons-not-to-join-replit
To achieve our mission of making programming more accessible around the world, we need our team to be representative of the world. We welcome your unique perspective and experiences in shaping this product. We encourage people from all kinds of backgrounds to apply, including and especially candidates from underrepresented and non-traditional backgrounds.
Location: Foster City, CA
Workplace: Hybrid
Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation.
Replit is building the world’s most accessible AI coding agent. Replit Agent can be used by anybody to bring their ideas to life. Whether it’s an app for yourself, the next great startup idea, or a tool to make you more productive at work, Replit Agent can help build it. Replit builds complete apps better than anybody thanks to our full suite of services that handle app integrations, storage, hosting, analytics, and more. We don’t just build apps in development, we handle the full lifecycle into production and beyond.
About the role:
Help power the development of Replit Agent as a technical leader for the Replit Cloud organization. You will report to the Vice President of Engineering. The Replit Cloud team builds Replit’s first party cloud infrastructure so users can build, scale, and succeed entirely on Replit. They manage databases, application storage, app publishing and hosting, development/production environment splitting, custom domains, and more. By having a set of first party services that integrate seamlessly, you will power one of Replit’s key product differentiators.
You will:
- Help lead major projects, either by taking new products from 0->1 or doubling down on our first party primitives to keep winning users.
- Work closely with designers and product managers, to quickly iterate on Replit Cloud to continually grow and improve the product.
- Identify the hardest technical and/or quality problems holding us back, and then build solutions.
- Mentor and develop new senior engineers to help grow the team.
- Ship product and build infrastructure as a true full stack builder using: TypeScript, React, CSS, Postgres, Go, and Terraform.
Examples of what you could do:
- Leverage our unique cloud infrastructure to build differentiated full product experiences, helping non-technical or semi-technical users remove roadblocks to success.
- Leverage AI agents to proactively optimize or suggest app improvements on latency, reliability, SEO, and more.
- Be part of engineering leadership, steering teams towards the highest impact work and supporting initiatives across the company.
Required skills and experience:
- Bachelor’s degree in Computer Science or related field, OR equivalent real-world experience in engineering roles
- 10+ years of experience in software with at least 3+ years in a technical leadership role.
PREFERRED QUALIFICATIONS
- Experience building user facing platform as a service products.
- Experience with AI/agentic systems.
- Previous experience at a high-growth startup.
Bonus Points:
- Open source project contributions.
WHAT WE VALUE:
- Problem-solving mindset: Ability to approach complex operational challenges systematically and devise effective solutions
- Self-directed and autonomous: Capable of working independently while collaborating effectively with cross-functional teams
- Strong communication skills: Ability to explain complex technical concepts to both technical and non-technical audiences
- Continuous learning: Passion for staying current with industry best practices and new technologies
- Focus on automation: Strong belief in automating repetitive tasks and building self-healing systems
This is a full-time role that can be held from our Foster City, CA office. The role has an in-office requirement of Monday, Wednesday, and Friday.
Full-Time Employee Benefits Include:
💰 Competitive Salary & Equity
💹 401(k) Program with a 4% match (US Only)
⚕️ Health, Dental, Vision and Life Insurance
🩼 Short Term and Long Term Disability
🚼 Paid Parental, Medical, Caregiver Leave
🏝 Flexible Time Off (FTO) + Holidays
🚗 Commuter Benefits (In-Office & US Only)
📱 Monthly Wellness Stipend
🧑💻 Autonomous Work Environment
🖥 In Office Set-Up Reimbursement (In-Office Only)
🚀 Quarterly Team Gatherings
☕ In Office Amenities (In-Office Only)
Want to learn more about what we are up to?
- Self-driving Company https://replit.com/blog/self-driving-company
- Replit Agent at Scale https://replit.com/blog/evaluating-and-improving-agent-at-scale
- AI Adoption https://replit.com/blog/ai-adoption
- Build Open-Source Apps https://replit.com/build/open-source-app-builder
Interviewing + Culture at Replit
- Operating Principles https://blog.replit.com/operating-principles
- Reasons not to work at Replit https://blog.replit.com/reasons-not-to-join-replit
To achieve our mission of making programming more accessible around the world, we need our team to be representative of the world. We welcome your unique perspective and experiences in shaping this product. We encourage people from all kinds of backgrounds to apply, including and especially candidates from underrepresented and non-traditional backgrounds.
Location: New York
ABOUT US:
AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL.
Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
Our customers include category-defining companies like Ramp https://modal.com/blog/how-ramp-built-a-full-context-background-coding-agent-on-modal, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.
We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.
Our team includes creators of popular open-source projects (e.g.,Seaborn https://github.com/mwaskom/seaborn,Luigi https://github.com/spotify/luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.
THE ROLE:
At Modal, we sell cloud services atop which our customers run their critical production systems. As a rapidly growing new cloud infrastructure company, we seek to improve our reliability dramatically while scaling the size of our platform, customer base, and team.
This role is for people who are deep systems thinkers, love stacking nines, and thrive on making others move faster at scale.
WHAT YOU'LL WORK ON:
- Identify architectural changes to improve reliability and performance
- Foster a culture of reliability across Modal’s engineering organization
- Define and implement operational processes such as deployments and upgrades
- Operate infrastructure like Kubernetes, Postgres, and Redis
- Participate in on-call rotations and respond to production incidents
YOU MAY BE A FIT IF:
- You have 5+ years of experience writing high-quality production code
- You have 2+ years of on-call experience for critical production services
- You have strong cloud skills and deep familiarity with at least one hyperscaler cloud (AWS preferred)
- You’re familiar with autoscaling, fleet management, and capacity planning at scale
- You’ve operated databases, monitoring, CI/CD, and other infrastructure at scale
- You’re able to work in person in our NYC or Stockholm offices
NICE-TO-HAVE:
- Experience owning and scaling Kubernetes clusters to thousands of nodes
- Experience with systems safety research (e.g., STAMP) and control theory
Location: United States & Canada
Workplace: Remote
About WorkOS 🚀
WorkOS builds modern developer tools and APIs that make it easy for companies to become Enterprise Ready. Our platform powers authentication, identity, authorization, and other critical infrastructure that developers need to securely scale their products to large organizations.
We recently raised a $100M Series C, valuing the company at $2B, led by Meritech and Sapphire with participation from Greenoaks, Craft, Abstract, and Audacious. WorkOS powers enterprise features for many of the fastest-growing AI companies, including OpenAI, Cursor, and Perplexity, Sierra, and Plaid.
As AI reshapes software, WorkOS is at the frontier of Human and Agent Authentication, Identity, and Access Control helping companies answer a new critical question: who are your agents, and what are they allowed to do? Our fast-growing customer base includes hundreds of modern software companies building the next generation of enterprise-ready products.
ABOUT THE ROLE 💭
The Platform team builds the shared backend components and development systems that every WorkOS product, workflow, and team member depends on.
On the platform side, we build common backend capabilities used across WorkOS, including our events infrastructure, webhooks, email delivery, outbox-pattern queues, and more. These systems allow product teams to scale without rebuilding the same critical primitives. Because they sit on critical paths across our products, scalability, latency, consistency, reliability, and operational simplicity matter deeply.
On the productivity side, we build the systems that take code from an idea to production, including CI/CD, build and test infrastructure, deployment workflows, and internal tooling. As agents play a larger role in software development and increase the volume of code and concurrent changes, we are rethinking this platform to scale with that volume through safe execution, fast feedback, relevant context, and verifiable outcomes.
Our internal teams are our customers. Success means they can build and operate products faster, adopt shared capabilities instead of creating one-off solutions, and confidently delegate more work to agents.
WHAT YOU’LL WORK ON ✔️
- Design, build, and operate high-throughput, low-latency shared backend systems that preserve consistency and durability through retries, duplicates, reordering, partial failures, and high concurrency
- Create platform interfaces, abstractions, and paved paths with a clean developer experience that makes shared capabilities easy for product teams to adopt
- Rotate across and embed with product teams to experience their workflows directly, understand their friction, and use those insights to shape platform investments
- Map evolving product-team needs and collaborate with the Foundations team to introduce new systems and primitives, such as scalable search, database partitioning, and archival strategies
- Own and evolve our CI/CD, build, test, deployment, and release infrastructure to shorten feedback loops and make production changes safer
- Reimagine CI/CD for an agentic software development lifecycle by building isolated, reproducible, and verifiable execution environments, along with automated loops that allow agents to diagnose failures, update changes, rerun validation, and safely move work through review, deployment, and production verification
- Instrument the entire software development lifecycle and use metrics such as feedback time, CI reliability, deployment frequency, lead time, and change failure rate to identify bottlenecks and verify that platform investments improve engineering outcomes
- Own platform reliability end to end, including observability, capacity planning, incident response, root-cause analysis, and prevention
- Shape the long-term platform strategy with a high bar for introducing new infrastructure. Thoroughly evaluate vendors and existing solutions, make deliberate build-versus-buy decisions, and account for operational complexity, lock-in, migration cost, reversibility, and long-term ownership
WHAT WE’RE LOOKING FOR 🌟
- 8+ years of software development experience, with a track record of owning high-impact technical projects
- Experience building and operating distributed systems or platform services at scale, with a strong understanding of event-driven systems, queues, concurrency, idempotency, consistency, backpressure, retries, and failure recovery
- Experience building or operating CI/CD, build systems, test infrastructure, deployment platforms, or similar developer tooling
- A track record of designing platforms, frameworks, and tooling with a clean developer experience that makes complex capabilities easy for other engineers to adopt and operate
- Strong operational instincts across observability, capacity planning, incident response, and reliability
- Hands-on experience with AI coding agents, or a strong interest in building agentic CI/CD systems, verifiable execution environments, automated feedback loops, evaluations, and verification
- Exceptional pragmatism and technical judgment. You treat major infrastructure changes with the gravity they deserve and make deliberate, evidence-based decisions about when to build, buy, or improve an existing system
- Ability to move between long-term architecture and hands-on implementation while making thoughtful tradeoffs in an ambiguous environment
- Strong written and verbal communication skills, including experience documenting systems and influencing technical direction across teams
- Familiarity with TypeScript, Node.js, React, Postgres, AWS, Terraform, and queueing or streaming systems such as SQS and Kinesis is helpful, but not required
We expect strong depth in either distributed platform systems or developer infrastructure, along with an interest in working across both.
Benefits and Perks (US Only) 💖
At WorkOS, we offer resources that emphasize personal and familial well-being. We offer healthcare coverage for you and your family, including medical, dental, and vision. We offer parental leave, paid-time off and fully remote working arrangements.
- 401k matching
- Competitive Equity
- Healthcare, dental and vision coverage
- FSA, ST/LT Disability, Voluntary Life
- Carrot fertility benefits
- 20 days paid vacation + 10 holidays + unlimited sick leave
- 12 weeks fully paid parental leave
- Fitness: Monthly stipend for gyms, yoga classes, race registrations or whatever keeps you active
- Wellness: Monthly stipend for a massage, meditations class, therapy, or activities that enhance your well-being
- Commuter benefits for hybrid employees in SF/NYC
- Unlimited token usage!
Please inquire directly with our recruiting team for benefits available to those working outside the US.
Equal Opportunity Employer
WorkOS is an equal opportunity employer, committed to diversity and inclusiveness. We will consider all qualified applicants without regard to race, color, nationality, gender, gender identity or expression, sexual orientation, religion, disability or age.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Location: Toronto; San Francisco; New York; Montreal
Workplace: Remote
WHO ARE WE?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
WHY THIS ROLE?
Are you energized by building high-performance, scalable and reliable machine learning systems? Do you want to help define and build the next generation of AI platforms powering advanced NLP applications? We are looking for a Site Reliability Engineer to join the Model Serving team at Cohere. The team is responsible for developing, deploying, and operating the AI platform delivering Cohere's large language models through easy to use API endpoints. In this role, you will work closely with many teams to deploy optimized NLP models to production in low latency, high throughput, and high availability environments. You will also get the opportunity to interface with customers and create customized deployments to meet their specific needs.
As a Site Reliability Engineer you will:
- Build self-service systems that automate managing, deploying and operating services.
- This includes our custom Kubernetes operators that support language model deployments.
- Automate environment observability and resilience. Enable all developers to troubleshoot and resolve problems.
- Take steps required to ensure we hit defined SLOs, including participation in an on-call rotation.
- Build strong relationships with internal developers and influence the Infrastructure team’s roadmap based on their feedback.
- Develop our team through knowledge sharing and an active review process.
You may be a good fit if you have:
- 5+ years of engineering experience running production infrastructure at a large scale
- Experience designing large, highly available distributed systems with Kubernetes, and GPU workloads on those clusters
- Experience with Kubernetes dev and production coding and support
- Experience with GCP, Azure, AWS, OCI, multi-cloud on-prem / hybrid serving
- Experience in designing, deploying, supporting, and troubleshooting in complex Linux-based computing environments
- Experience in compute/storage/network resource and cost management
- Excellent collaboration and troubleshooting skills to build mission-critical systems, and ensure smooth operations and efficient teamwork
- The grit and adaptability to solve complex technical challenges that evolve day to day
- Familiarity with computational characteristics of accelerators (GPUs, TPUs, and/or custom accelerators), especially how they influence latency and throughput of inference.
- Strong understanding or working experience with distributed systems.
- Experience in Golang, C++ or other languages designed for high-performance scalable servers).
FULL-TIME EMPLOYEES AT COHERE ENJOY THESE PERKS:
- A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
- Full health and dental benefits, including a separate budget for mental health.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months, for either parent.
- Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days!)
- Budget for traveling to other offices if you are remote, plus an annual company offsite.
HOW AND WHERE WE WORK:
- Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
- For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
- For those not near an office: a co-working benefit so you can work alongside others in your city.
- Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form https://docs.google.com/forms/d/12a6IrLdF3kI2nonKSr4tiFuz18rLQbaeYV-JM9L4o9Q/edit, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers https://cohere.com/careers page.
Location: San Francisco; New York; Toronto; Montreal
Workplace: Hybrid
WHO ARE WE?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
WHY THIS ROLE?
Are you energized by building high-performance, scalable and reliable machine learning systems? Do you want to help define and build the next generation of AI platforms powering advanced NLP applications? We are looking for Members of Technical Staff to join the Model Serving team at Cohere. The team is responsible for developing, deploying, and operating the AI platform delivering Cohere's large language models through easy to use API endpoints. In this role, you will work closely with many teams to deploy optimized NLP models to production in low latency, high throughput, and high availability environments. You will also get the opportunity to interface with customers and create customized deployments to meet their specific needs.
You may be a good fit if you have:
- 5+ years of engineering experience running production infrastructure at a large scale
- Experience designing large, highly available distributed systems with Kubernetes, and GPU workloads on those clusters
- Experience with Kubernetes dev and production coding and support
- Experience with GCP, Azure, AWS, OCI, multi-cloud on-prem / hybrid serving
- Experience in designing, deploying, supporting, and troubleshooting in complex Linux-based computing environments
- Experience in compute/storage/network resource and cost management
- Excellent collaboration and troubleshooting skills to build mission-critical systems, and ensure smooth operations and efficient teamwork
- The grit and adaptability to solve complex technical challenges that evolve day to day
- Familiarity with computational characteristics of accelerators (GPUs, TPUs, and/or custom accelerators), especially how they influence latency and throughput of inference.
- Strong understanding or working experience with distributed systems.
- Experience in Golang, C++ or other languages designed for high-performance scalable servers).
FULL-TIME EMPLOYEES AT COHERE ENJOY THESE PERKS:
- A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
- Full health and dental benefits, including a separate budget for mental health.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months, for either parent.
- Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days!)
- Budget for traveling to other offices if you are remote, plus an annual company offsite.
HOW AND WHERE WE WORK:
- Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
- For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
- For those not near an office: a co-working benefit so you can work alongside others in your city.
- Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form https://docs.google.com/forms/d/12a6IrLdF3kI2nonKSr4tiFuz18rLQbaeYV-JM9L4o9Q/edit, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers https://cohere.com/careers page.
Location: Stockholm
ABOUT US:
AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL.
Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
Our customers include category-defining companies like Ramp https://modal.com/blog/how-ramp-built-a-full-context-background-coding-agent-on-modal, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.
We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.
Our team includes creators of popular open-source projects (e.g.,Seaborn https://github.com/mwaskom/seaborn,Luigi https://github.com/spotify/luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.
THE ROLE:
We are looking for strong engineers with experience and interest in designing, building, and maintaining the novel, high-performance systems that make up our serverless platform.
YOU MAY BE A FIT IF:
- You have 5+ years of experience writing high-quality production code
- You’ve built high-performance distributed systems at a large scale (the more battle scars, the better)
- You have strong cloud skills
- You have strong knowledge of low-level operating system foundations (Linux kernel, file systems, containers, etc.)
- You have experience with performance engineering (tell us a story of when you shaved off a few milliseconds!)
- You’re able to work in person in our Stockholm office
- You’re able to participate in our on-call rotation and respond to production incidents
NICE-TO-HAVE:
- Prior experience with Rust
Location: San Francisco
Workplace: OnSite
ABOUT US:
AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL.
Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
Our customers include category-defining companies like Ramp https://modal.com/blog/how-ramp-built-a-full-context-background-coding-agent-on-modal, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.
We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.
Our team includes creators of popular open-source projects (e.g.,Seaborn https://github.com/mwaskom/seaborn,Luigi https://github.com/spotify/luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.
THE ROLE:
We’re looking for strong backend engineers who love building developer tools used by the largest AI companies in the world. You’ll be building for things at scale, but also for new AI workflows that change every day.
YOU MAY BE A FIT IF:
- You’ve built and shipped modern web applications end-to-end
- You’re comfortable working across the stack: TypeScript on the frontend, Python services on the backend, and ClickHouse for data and analytics
- You have deep knowledge of observability tools and patterns used for large-scale workloads such as custom sandboxes and training and inference for large language models (LLMs) and diffusion models
- You have experience with at least one of the following: billing/payments systems, B2B SaaS tooling, enterprise software, or LLM/diffusion model inference and training workloads
- You have strong product instincts and think about customer problems, not just tickets
- You’re able to participate in our on-call rotation and respond to production incidents
- You make good tradeoffs between shipping fast and building for scale
- You’re able to work in person in our NYC or SF office
Location: San Francisco; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
We are looking for Software Engineers to join our team. This is a specialized, high-impact role sitting at the intersection of high-performance computing (HPC) and Large Language Model (LLM) engineering. You will not just be building the automated "speedometer and diagnostic" suite for our next-generation AI infrastructure; you will be defining the roadmap, driving key technical decisions, and taking full ownership of the future of this work.
RESPONSIBILITIES
- Benchmarking: Evaluate, run and automate standard LLM quality benchmarks (GSM8K, MMLU) alongside custom performance suites for specific workloads (e.g., long-context window, KV cache reuse, disaggregated serving).
- DevEx Improvement: Develop and maintain internal GPU-enabled development environments (similar to GitHub Codespaces). You will ensure the team has seamless, high-performance "dev machines" optimized for model experimentation.
- Tool Development: Build and contribute to open-source tools such as InferenceMAX and genai-bench to automate model evaluation, benchmarking and analysis.
- System Profiling: Use profilers like PyTorch Profiler, NVIDIA Nsight Systems and py-spy to collect performance profiles, identify bottlenecks, and debug the compute/networking stack.
- Monitoring & Observability: Develop real-time dashboards and alerts to monitor system health, model startup times, and runtime performance.
- Continuous Integration: Automate performance testing via CI/CD pipelines to catch regressions and build release workflow automation for the model runtimes stack.
- Optimization Automation: Build tools to find the "Pareto frontier"—identifying the absolute best configuration (latency vs. cost vs. quality) for a given model and workload.
REQUIREMENTS
This is a mid-senior, high leverage role. We care about your technical depth, strong communication skills to drive cross-team efforts, ability to navigate vague requirements and mentor other engineers. We want to talk to you if you have:
- A Love for Systems & Hardware: You aren’t just interested in the AI; you want to understand GPU memory subsystems, InfiniBand, and how data moves across a cluster.
- An Automation Mindset: You believe that if a task has to be done twice, it should be scripted. You have a passion for stress-testing and fuzzy testing to find the "breaking point" of a system.
- Mathematical Curiosity: A desire to understand the underlying math of Transformers and how it translates into FLOPs and memory requirements.
- Technical Toolkit: Familiarity with Python, and an eagerness to master the NVIDIA software stack. C++ familiarity is good to have.
WHY THIS ROLE
- Direct Impact: Your tools will be the gatekeeper for what defines "good" performance for our customers.
- Deep Learning (Literally): You will gain world-class expertise in GPU orchestration and LLM inference that few engineers in the industry possess.
- High Ownership: As the lead of a small team, you will have the autonomy to build tools from scratch and contribute to open-source projects.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: Colombia; Ukraine; Poland; Brazil; Argentina; Georgia
Workplace: Remote
Solvd Inc. is a rapidly growing AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence. We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business outcomes.
Following the acquisition of Tooploox, a premier AI and product development company, Solvd now offers true end-to-end delivery—from strategic advisory and solution design to custom AI development and enterprise-scale implementation. Our capability centers combine deep technical expertise, proven delivery methodologies, and sector-specific knowledge to address complex business challenges quickly and effectively.
Solvd is looking for a highly skilled Data Engineer to help design and build modern data platforms that support large-scale risk and compliance initiatives for enterprise clients. In this role, you will architect and implement scalable data systems, real-time pipelines, and analytics capabilities that transform complex datasets into actionable insights.
You will partner with cross-functional teams—including data scientists, software engineers, and product stakeholders—to enable reliable, high-quality data solutions. This role requires strong technical depth in big data technologies, AWS services, and distributed systems, along with the ability to understand business needs and contribute to strategic decision-making.
WHAT YOU WILL DO
Data Architecture and Platform Development
- Design, build, and optimize scalable data infrastructure for risk and compliance workloads
- Develop batch and streaming pipelines using modern big data technologies
- Implement robust ETL and ELT workflows across diverse structured and unstructured data sources
Cloud Data Engineering
- Work extensively with AWS services including EMR, Redshift, S3, Glue, Lambda, Kinesis, and related data tools
- Build high-throughput, low-latency systems that support real-time or near-real-time decision making
Collaboration and Delivery
- Partner with data scientists, analysts, and engineering teams to deliver reliable and well-documented datasets
- Translate business requirements into technical specifications and scalable data solutions
- Mentor team members and contribute to best practices and reusable frameworks within Solvd
Automation and Continuous Improvement
- Streamline reporting, analytics, and data preparation processes
- Replace manual workflows with automated, repeatable systems
- Support ongoing performance tuning, monitoring, and platform optimization
BASIC QUALIFICATIONS
- Bachelor’s degree in Computer Science, Engineering, Mathematics, or similar
- 3 or more years of hands-on experience in data engineering or related fields
- Strong proficiency in SQL and data modeling for analytics and warehousing
- Experience building ETL or ELT pipelines at scale
- Experience with big data technologies such as Hadoop, Hive, Spark, HBase, or EMR
- Knowledge of distributed systems and data storage principles
- Basic scripting skills in Python or Scala
- Familiarity with machine learning concepts
PREFERRED QUALIFICATIONS
- Experience with AWS data services such as Redshift, S3, Glue, EMR, Kinesis, Firehose, and Lambda
- Experience working with non-relational data stores such as document, key-value, column-family, or graph databases
- Experience collaborating with cross-functional risk, compliance, or analytics teams
- Strong understanding of data governance, quality, and security best practices
When you join Solvd, you'll…
- Shape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation.
- Be part of a global team with equal opportunities for collaboration across continents and cultures.
- Thrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards.
Ready to make an impact?
If you're excited to build things that matter, champion responsible AI, and grow with some of the industry’s sharpest minds. Apply today and let’s innovate together.
Solvd is an equal opportunity employer.
Location: New York; San Francisco; Toronto; Montreal
Workplace: Remote
WHO ARE WE?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
Role Overview:
Our team is a fast-growing group of committed researchers and engineers. The mission of the team is to build reliable machine learning systems and optimize audio inference serving efficiency using innovative techniques. As an engineer on this team, you will work on advancing core audio model serving metrics, including latency, throughput, and quality by diving deep into our systems, identifying bottlenecks, and delivering creative solutions for audio processing and streaming workloads.
You’ll collaborate closely with both the training and serving infrastructure teams to ensure seamless integration between model development and deployment, with a special focus on real-time and streaming audio inference.
Please Note: We have offices in Toronto, Montreal, San Francisco, New York, Paris, Seoul and London. We embrace a remote-friendly environment, and as part of this approach, we strategically distribute teams based on interests, expertise, and time zones to promote collaboration and flexibility. You'll find the Model Efficiency team concentrated in the EST and PST time zones, these are our preferred locations.
Qualifications:
- Significant experience developing high-performance audio or machine learning inference systems.
- Proficiency with programming languages such as C++ and Python.
- Hands-on experience with deep learning models for audio, speech, or language applications.
- A bias for action and a strong results-oriented mindset.
It is a big plus if you also have considerable experience with:
- GPU programming, low-level system optimization, model parallelization techniques over multiple GPUs
- Have experience with duplex real-time streaming architectures.
- Internals of machine learning frameworks for audio (such as PyTorch, TensorFlow, or specialized audio libraries).
- Have experience with inference framework like vLLM, SGLang, Tensort-LLM, or custom distributed inference systems
- Sequence modeling (e.g., transformers for audio/speech) and end-to-end audio pipeline optimization
Working location:
This role can be based remotely or from one of our office locations listed on the job description - there is no minimum in-office qualification requirement. We care most about hiring exceptional people regardless of locations, though please check the location listed on the posting for guidance around the core time zone or working hours alignment expected for the role.
FULL-TIME EMPLOYEES AT COHERE ENJOY THESE PERKS:
- A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
- Full health and dental benefits, including a separate budget for mental health.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months, for either parent.
- Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days!)
- Budget for traveling to other offices if you are remote, plus an annual company offsite.
HOW AND WHERE WE WORK:
- Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
- For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
- For those not near an office: a co-working benefit so you can work alongside others in your city.
- Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form https://docs.google.com/forms/d/12a6IrLdF3kI2nonKSr4tiFuz18rLQbaeYV-JM9L4o9Q/edit, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers https://cohere.com/careers page.
Location: New York; San Francisco; Toronto; Montreal
Workplace: Remote
WHO ARE WE?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
Role Overview:
Our team is a fast-growing group of researchers and engineers focused on building reliable ML systems and pushing the boundaries of LLM inference efficiency. We develop techniques that improve how models execute in production, driving lower latency, higher throughput, and consistent quality across diverse workloads.
Please Note: We have offices in Toronto, Montreal, San Francisco, New York, Paris, Seoul and London. We embrace a remote-friendly environment, and as part of this approach, we strategically distribute teams based on interests, expertise, and time zones to promote collaboration and flexibility. You'll find the Model Efficiency team concentrated in the EST and PST time zones, these are our preferred locations.
Job Responsibilities:
As an engineer on this team, you’ll work across the inference stack to improve core performance metrics by diving deep into model execution, identifying bottlenecks, and developing innovative optimizations. You’ll collaborate closely with modeling and systems teams to experiment, measure, and ship improvements that meaningfully accelerate inference. As the team evolves, you’ll have opportunities to build expertise in advanced performance techniques, including GPU/CUDA optimizations, kernel-level improvements, and model execution strategies for MoE and large-scale architectures.
Qualifications:
- 5+ years of experience writing high-performance, production-quality code
- Strong programming skills in C++ or Python (Rust/Go also welcome)
- Experience working with large language models and familiarity with the LLM inference ecosystem (e.g., vLLM, SGLang, etc.)
- Ability to diagnose and resolve performance bottlenecks across the model execution stack
- A strong bias for action — you ship fast, measure impact, and iterate
It’s a big plus if you have experience with:
- GPU programming, CUDA, or low-level systems optimization
- Language modeling with transformers (MoE, speculative decoding, KV-cache optimizations)
- Scaling performance-critical distributed systems (e.g., computation, search, storage)
Working Location:
This role can be based remotely or from one of our office locations listed on the job description - there is no minimum in-office qualification requirement. We care most about hiring exceptional people regardless of locations, though please check the location listed on the posting for guidance around the core time zone or working hours alignment expected for the role.
FULL-TIME EMPLOYEES AT COHERE ENJOY THESE PERKS:
- A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
- Full health and dental benefits, including a separate budget for mental health.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months, for either parent.
- Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days!)
- Budget for traveling to other offices if you are remote, plus an annual company offsite.
HOW AND WHERE WE WORK:
- Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
- For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
- For those not near an office: a co-working benefit so you can work alongside others in your city.
- Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form https://docs.google.com/forms/d/12a6IrLdF3kI2nonKSr4tiFuz18rLQbaeYV-JM9L4o9Q/edit, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers https://cohere.com/careers page.
Location: Hybrid - San Francisco
About Vercel:
Vercel is the agentic infrastructure company, freeing people and agents to ship what's next. For more than a decade we've helped builders move from idea to production with speed, security, and exceptional developer experience.
Now we're scaling our products for both agents and people to ship and run software, built in the open and trusted by OpenAI, PayPal, Ramp, Supreme, and millions of developers worldwide.
About the role
You’ll lead the team responsible for Vercel’s CDN, proxy, and edge caching systems—the core infrastructure that powers performance, reliability, and cost efficiency for every customer request at Vercel. Your mandate is twofold: Operate critical systems exceptionally (latency, reliability, COGS), and align the team to product and business goals, translating strategy into a clear roadmap.
You will set direction, grow people, and create the conditions for high trust, high autonomy, and high output—balancing technical depth with strong people leadership. This is a manager role, not a principal IC role. You’ll code when it’s the highest leverage (e.g., prototypes/unblocking), but your default is delegation, coaching, and alignment.
What you need
8+ years building and operating large-scale distributed systems
3+ years managing engineers (managing managers is a plus)
Demonstrated success leading CDN/proxy/caching/edge or similar high-throughput, low-latency infrastructure
Proven ability to translate business goals into technical strategy and drive cross-org alignment
Track record establishing trust, psychological safety, and clear expectations; skilled at timely, candid feedback
Strong facilitator in technical conflict—you listen, synthesize, decide, and bring the team with you
Competence across HTTP, TLS, caching strategies, load shedding, capacity planning, observability, and cost optimization
Bonus if you
Have experience with
Go, Lua, or Node at the edge; running high-signal hiring pipelines
Collaborating with product/PMM on customer-facing narratives.
Benefits & Compensation:
Competitive compensation package, including equity.
Inclusive Healthcare Package.
Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
Flexible Time Off.
We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.
The San Francisco, CA base pay range for this role is $196,000.00 - $336,000.00. Actual salary will be based on job-related skills, experience, and location. Compensation outside of San Francisco may be adjusted based on employee location. The total compensation package may include benefits, equity-based compensation, and eligibility for a company bonus or variable pay program depending on the role. Your recruiter can share more details during the hiring process.
Disclosures:
Privacy:
Please review our
Job Applicant Privacy Policy
for more information on how we handle your data.
Equal Opportunity:
Vercel is committed to fostering and empowering an inclusive community within our organization. We do not discriminate on the basis of race, religion, color, gender expression or identity, sexual orientation, national origin, citizenship, age, marital status, veteran status, disability status, or any other characteristic protected by law. Vercel encourages everyone to apply for our available positions, even if they don't necessarily check every box on the job description.
Location: London
Workplace: OnSite
About Clarity
We’re pioneering Agentic AI — systems that don’t just respond, but reason, act, and adapt autonomously in complex workflows. This is about crafting AI Agent Experiences — designing agents that collaborate seamlessly with humans, learn from context, and make every customer interaction faster, smarter, and more empathetic.
You’ll own the technical vision and turn requirements into a live, reliable product used by brands like Grubhub, Booking.com http://Booking.com, Dropbox, Uber, Careem, and Fubo. You’ll collaborate directly with engineers, other tech leads, directors, and the CTO to evolve ambitious prototypes into a rock‑solid, scalable platform
What you’ll actually do
50% Build — design & ship
- Agentic AI for CX: Real‑time assistants that listen to calls/chats, retrieve from customer KBs, and draft responses with human‑in‑the‑loop controls.
- Structured extraction: Schema‑driven pipelines over unstructured text (and other modalities) using retrieval, tool‑use, and robust LLM prompting.
- Hybrid anomaly detection: Blend classical time‑series methods (e.g., decomposition, change‑point, forecasting) with LLM‑aware, contextful detectors for seasonality, spikes, step‑changes, and drift.
- Novelty discovery: Embedding‑based clustering and drift, topic surfacing, LLM summarization of emerging themes with deduplication and evidence links.
- Alerting & scoring: Severity/impact ranking, de‑noising, suppression/cool‑downs, routing, and feedback loops.
25% Architect & scale
- Own reliability, latency, and cost. Design online/offline eval harnesses, canaries, and SLAs; operate GPUs/accelerators where needed.
- Stand up and harden RAG pipelines (indexing, retrieval policies, grounding, guardrails) and agent frameworks.
- Take basic infra ownership on GCP (or AWS/Azure): networking, autoscaling, CI/CD, IaC, observability, and cost tuning.
- Participate in on‑call for your area and drive root‑cause analysis with crisp follow‑ups.
15% Collaborate
- Pair with back‑end & front‑end to wire extractors/detectors and agents into ticketing, voice, and analytics stacks (APIs, webhooks, real‑time streams).
- Partner with PMs/CX to evolve taxonomies, schemas, and guardrails; translate business problems into shipped ML features.
10% Align & showcase
- Gather requirements from CX and product leads, demo new capabilities to execs & customers, and document impact with precision/recall, alert quality, latency, and cost metrics.
What makes you a great fit
- Startup hacker mindset: You self‑start from zero, respect no silos, and carry work from prototype to production. 🛠️
- AI‑native dev tools are your daily drivers: Cursor, v0, Claude Code (or similar).
- 7–10 years building production ML/back‑end systems; 2+ years leading while coding.
- Expert Python; strong back‑end chops (e.g., FastAPI, gRPC, Postgres, pub/sub/streams).
- Agents & RAG: Fluency with at least one agent framework (ADK preferred). Proven track record shipping AI agents and building RAG pipelines.
- LLM + DS depth: Prompting/tooling, retrieval design, LLM evals; hands‑on with time‑series analysis (forecasting, change‑point, drift).
- Cloud & ops: Basic infra ownership on GCP (or AWS/Azure): networking, autoscaling, CI/CD, IaC, observability, and cost control.
- Communication: You explain results clearly, align stakeholders, and write crisp docs.
Bonus points
- DevOps wizardry; GPU/accelerator experience.
- Multimodal pipelines (text + voice + screenshots).
- Prior experience in contact center/CX analytics or novelty/anomaly systems.
- Founder or founding engineer experience
Budapest
140 000 – 190 000 $
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.
