Мы — амбициозная команда специалистов, которая ставит перед собой амбициозную задачу по разработке и внедрению ИИ-агента для управления технологическими рисками Банка. Наше решение помогает быстро выявлять, оценивать и минимизировать последствия технологических рисков. В нашей команде ты сможешь быть вкладом в создание и развитие продукта с 0 и работать с передовыми технологиями, свободные коммуникации и быстрые решения без долгих согласований.
Задачи:
— проектировать и разрабатывать backend-сервисы на Python для LLM-агентов и ML-пайплайнов (низкие задержки, высокая надёжность, observability)
— выстраивать и развивать архитектуру агентских систем (оркестрация инструментов, память, планирование, безопасные guardrails, оценка качества)
— внедрять ML System Design подходы: искать и применять передовые идеи и мировой опыт в области архитектур агентских систем
— работать с данными и интеграциями: очереди/стриминг, базы, кэш, внешние API
— проводить технические исследования (R&D), быстро прототипировать, измерять, масштабировать в прод
— развивать платформу: тестирование, CI/CD, мониторинг, трассировка, расходы
— влиять на инженерную культуру: код-ревью, дизайн-сессии, менторство.
Требования:
— от 4 лет промышленной backend-разработки на Python с акцентом на надёжность и производительность
— опыт проектирования распределённых систем и высоконагруженных сервисов
— уверенная математическая база (вероятность/статистика/оптимизация), инженерный вкус и привычка мерить всё метриками
— практика работы с ML-системами в проде: фичи, офлайн/онлайн-оценка, A/B, наблюдаемость качества
— навык разбираться в новых подходах (LLM-агенты, инструменты, память, RAG, оценка), критически их проверять и доводить до результата
— готовность брать ответственность за продуктовые эффекты, а не только за код.
Будет плюсом:
— опыт построения agentic-архитектур (планировщики, многoшаговые цепочки, инструментализация, безопасность)
— опыт реализации высокоэффективного инференса LLM моделей, глубокое понимание работы kernel для инференса
— вклад в open-source или публикации/доклады
— знание домена рисков.
Location: New York; San Francisco
ABOUT US:
AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL.
Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
Our customers include category-defining companies like Ramp https://modal.com/blog/how-ramp-built-a-full-context-background-coding-agent-on-modal, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.
We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.
Our team includes creators of popular open-source projects (e.g.,Seaborn https://github.com/mwaskom/seaborn,Luigi https://github.com/spotify/luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.
THE ROLE:
Most of the value of owning a model shows up at serving time. We're building a platform that covers the whole life of an LLM -- train it, deploy it, observe it -- and inference is where teams feel the difference every day. We already run elastic inference, sandboxes, distributed volumes, and multi-node training, and we control the infrastructure underneath, so the serving stack is ours to shape rather than something we resell.
You will do hands-on inference research at Modal, working with the research lead to pick high-impact bets and owning them end to end. The bets that matter most are the ones that move cost per token and tail latency on the workloads our customers actually run.
WHAT YOU'LL DO:
- Own end-to-end inference research bets: speculative decoding, disaggregated prefill/decode, quantization (FP8, INT4), KV-cache and memory management, autoscaling for spiky serverless traffic, and whatever else the research agenda calls for.
- Train custom speculators against real production traffic and feed what you learn back into target models -- acceptance length is the metric that decides the win.
- Work directly with customers alongside our Forward Deployed Engineers to deploy and tune models, and bring what you learn back into the research.
- Carry and expand collaborations with outside research labs, for example:
- our work with ZLab on DFlash https://modal.com/blog/spec-is-all-u-need, a speculator design built on KV injection and blockwise parallel drafting
- our work with SGLang on specdec https://modal.com/blog/host-overhead-inference-efficiency and multimodal inference https://modal.com/blog/boosting-multimodal-inference-performance-by-greater-than-10-with-a-single-python-dictionary performance
- our work on Flash Attention 4 kernels https://modal.com/blog/flash-attention-4-faster
- Work with engineering to turn frontier serving techniques into products: primitives for disaggregation, fast weight refresh for models that keep training after deployment, observability for quality and latency in production, or even a next-generation inference engine.
- Help shape the research agenda. None of the above is prescriptive; your work will help guide our future.
REQUIREMENTS:
- A research-leaning or systems background in LLM inference, with work you can point to.
- Fluency in the LLM serving stack, from kernels and quantization up to schedulers and autoscaling.
- A record of shipping research or systems that other people build on, whether in a lab or in industry.
- The drive to independently take a research bet from idea to result, working in the open with the rest of the team.
- Ability to work in-person, in our NYC or San Francisco office.
Location: Remote: United States; San Francisco HQ; Remote: Canada
Workplace: Remote
At Render, we’re building the modern cloud platform for developers creating AI-native, full-stack, multi-service applications. Our mission is to eliminate the tradeoff between the power of hyperscalers and the simplicity of developer-friendly platforms—so teams can ship fast, scale reliably, and focus on their product, not infrastructure.
Unlike complex hyperscalers or ephemeral edge/serverless solutions, Render offers a developer-first experience with persistent compute, dynamic autoscaling, built-in orchestration, and observability, allowing teams to launch, scale, and manage real-world applications without writing infrastructure code or managing servers. Whether you're building LLM-powered applications, scalable SaaS products, or async processing pipelines, Render empowers teams to move fast and scale confidently from MVP to millions of users.
Our platform is trusted by over 7 million developers worldwide and continues to grow rapidly. In February 2026, we raised an additional $100M in Series C financing, bringing our total funding to $260M, to accelerate our vision of making cloud infrastructure both powerful and intuitive—designed for the speed of modern AI development.
We’re a diverse and talented team that values craft, velocity, and user experience. If you’re excited to help shape the future of the intelligent cloud and empower developers everywhere, we’d love to hear from you.
APPLYING TO RENDER
We're seeking candidates who possess high integrity, humility, and an insatiable drive to learn. Through reasoned discussions and continuous feedback, we strive to improve both individually and collectively. We foster an environment of mutual trust and respect, empowering effective debate to achieve the best outcomes for our customers and team.
We especially encourage members of underrepresented groups in the tech community to apply and understand that not all successful candidates will meet each requirement listed.
Our interview process is unique to each role, and we value the candidate experience just as much as our customer experience. We hope your conversations with us reflect a thoughtful process that is illuminative, enjoyable, and respectful of your time.
ABOUT THE ROLE
Render's mission is to eliminate the undifferentiated work that goes into building software products by offering an easy-to-use, powerful cloud platform for developer teams of all sizes.
We are scaling rapidly. Our customers have created millions of services on our platform, and the numbers continue to accelerate. Our customers trust us to deliver a secure, reliable and performant cloud — this is our top priority as a company.
By joining us at an early stage, you will design and build the cloud platform you've always wanted for yourself, and make decisions that will shape our product and company, directly impacting developers around the globe.
Render builds and orchestrates a growing number of kubernetes clusters on different hyperscalers and recently, our own hardware. We leverage open source and industry-standard technologies, modifying and extending the core components to meet the unique reliability, performance, and scaling demands of our platform.
We are looking for engineers with deep specialization in cloud and compute infrastructure. We are particularly interested in experience with Kubernetes and container orchestration, micro VMs, controllers, operators, and the automation and self-healing of large scale distributed systems.
Areas of focus for the team this year will unlocking bottlenecks to scale our clusters while also automating the multi-step creation, configuration, testing, and tuning of Render clusters. We will expand Render to new regions, our own bare metal, and start orchestrating micro VMs outside of Kubernetes entirely.
WHAT YOU'LL DO
- Own Render's core compute infrastructure across multiple cloud providers, regions, and data centers. You'll shape how we evolve our compute platform as we rapidly scale.
- Design and build capabilities that give users greater performance and flexibility in how their services are built, deployed, perform, and stay available even when underlying resources go down.
- Investigate challenging cloud and compute issues across the stack, from the kernel and data plane to our kubernetes cluster, control plane, and other orchestration mechanisms.
- Improve the performance and reliability of our infrastructure through systematic profiling, experimentation, and tuning.
- Partner with engineers across the company to build a platform that is stable, predictable, and secure.
- Participate in our on-call rotation. Help continuously improve how we detect, respond to, and learn from incidents.
WHAT WE'RE LOOKING FOR
- At least 7 years of experience building and operating large-scale platform or compute infrastructure.
- Deep expertise in operating, scaling, and enhancing Kubernetes clusters or similar resource/container orchestration system.
- Experience developing in Go, Rust, or similar languages to develop custom infrastructure components, scheduling, controllers, that apply business logic to resource management.
- Comfort going broad and deep in a complex systems, making tradeoffs to improve performance and efficiency without sacrificing reliability.
- Strong experience designing, debugging, and operating distributed systems.
- Experience planning and executing rapid, high-risk upgrades, changes with minimal downtime to user services.
NICE-TO-HAVES
- Background in virtualization technologies like Firecracker, gVisor, Kata, or similar.
- Experience optimizing the performance of node, pod, and container spin-up times.
- Familiarity with eBPF, Linux kernel internals, resource management.
- Comfort securing and isolating workloads in multi-tenant execution environments.
RELEVANT LINKS FROM THE RENDER INFRASTRUCTURE TEAM
- The Namespaces Scaling Trap https://www.youtube.com/watch?v=NCKhoYsNsmE (video podcast interview) and related article How We Found 7 TiB of Memory Just Sitting Around https://render.com/blog/how-we-found-7-tib-of-memory-just-sitting-around
- SEV0 SF 2025 | Boundary Cases: Technical and social challenges in cross-system debugging https://www.youtube.com/watch?v=d4hAyzmBNXk
- Distributing Global State to Serve over 1 Billion Daily Requests https://render.com/blog/distributing-global-state-to-serve-over-1-billion-daily-requests
- Breaking down OpenAI's outage: How to avoid a hidden DNS dependency in Kubernetes https://render.com/blog/a-hidden-dns-dependency-in-kubernetes
- Kubernetes Informers are so easy... to misuse! https://render.com/blog/kubernetes-informers
If this role excites you but you don’t meet every single requirement, we’d still love to hear from you—your unique experience might be just what we need.
BENEFITS
- 4 weeks of paid vacation.
- 14 weeks of fully paid parental leave for all parents to bond with a newly born, adopted, or fostered child. We will also work with you to create a supportive plan of return.
- Long-term disability, life insurance, and 401K plans.
- 100% employer-paid medical coverage and 99% employer-paid dental and vision coverage for you and a dependent. FSAs and HSAs are available as well.
- Monthly lifestyle stipend for wellness, mental health and therapy, hobbies, etc.
- Monthly cell phone and internet subsidy.
- Commuter benefits for Renders in the Bay Area, and home office stipends for remote Renders.
- Continuous learning benefits & related support.
This position is generally not eligible for new visa sponsorship. At Render's discretion, the business may sponsor existing visa transfers. Applicants who require sponsorship must receive business authorization.
Render is an equal-opportunity employer. We know that employing a team rich in diverse thoughts, experiences, and opinions allows our employees, product, and community to flourish. We make all employment decisions including hiring, evaluation, termination, promotional, and training opportunities, without regard to race, religion, color, sex, age, national origin, ancestry, sexual orientation, physical handicap, mental disability, medical condition, disability, gender or identity or expression, pregnancy or pregnancy-related condition, marital status, height and/or weight.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
We encourage all who are interested to apply. We can't wait to hear from you!
Render — CCPA Applicant Privacy Notice https://drive.google.com/file/d/1wKr9IejoT5McFrs9I2mahQnf6AFwb3z2/view
Render — GDPR Applicant Privacy Notice https://drive.google.com/file/d/1_8jtyXQ1HdRdTdQn9sZ7n-R-zAGBmsFa/view
Location: Office Based - London, UK
This is an opportunity for a prospective Linux Engineer/Administrator with a passion for Linux and Customer Success to build a career with Canonical and support the technical needs of customers leveraging Ubuntu and open source products. You will be accountable for delivering technical support to our employees and customers, as well as facilitating AV support for office conferences and events. If you have an affinity for open source development and a passion for technology, then you will enjoy working with some of the best people in the industry at Canonical.
Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. Our customers include the world's leading public cloud and silicon providers, and industry leaders in many sectors. The company is a pioneer of global distributed collaboration, with 1100+ colleagues in 75+ countries and very few office based roles. Teams meet two to four times yearly in person, in interesting locations around the world, to align on strategy and execution.
The company is founder led, profitable and growing.
While our engineers regularly solve deeply interesting, complex technical problems - from triaging cloud environments to root-cause analysis on unseen Linux kernel crashes - this is fundamentally a role rooted in human connection. You will act as a trusted peer and technical guide to external engineering teams, translating intricate open-source challenges into clear, empathetic solutions. We are rapidly expanding and looking for brilliant problem solvers who are just as passionate about building strong, collaborative relationships with customers as they are about the next generation of Canonical solutions.
Location: Office Based in London, England.
The role entails
Empathetic Engagement: Partner directly with customers across remote sessions, ticketing,, and live conversations to deeply understand and resolve their technical roadblocks.
Collaborative Problem Solving: Work hand-in-hand with internal engineering teams and regional peer groups to bridge the gap between complex code fixes and real-world customer satisfaction.
True Ownership: Manage your support cases with a strong sense of personal integrity, ensuring commitments are honored and customer expectations are communicated transparently and predictably.
Ubuntu Lifecycle Guidance: Develop a rich understanding of the Ubuntu development process, empowering you to give customers clear, human context regarding timelines for engineering fixes.
Knowledge Advocacy: Author and maintain accessible knowledge base articles, ensuring lessons learned are shared openly to elevate the entire open-source community.
Operational Reliability: Participate in a regular weekend working rotation to maintain seamless, high-touch continuity of care for our global partners.
What are we looking for in you
Communication Excellence: Exceptional written and spoken English, with a natural ability to convey technical complexity clearly, warmly, and compellingly.
The Soft-Skill Edge: A genuine passion for helping people, paired with the emotional intelligence to navigate high-stakes technical situations with composure and empathy.
Academic Dedication: Exceptional academic track record from both high school and university.
Educational Background: An undergraduate degree in a technical subject or a compelling narrative about your alternative chosen path.
On-Site Technical Leadership: Based in our state-of-the-art London, UK office, you will serve as a key technical support resource for our local teams and employees.
Driven Mindset: A proven track record of going above-and-beyond expectations to deliver meaningful, outstanding results for teams or customers.
Linux & Cloud Familiarity: A solid foundation in Linux systems, demonstrated through university projects, lab work, or personal exploration, with exposure to one or more of the following:
Virtualization & Cloud: Using KVM or OpenStack.
Containers: primarily Docker, LXD/LXC, or Kubernetes.
Storage Ecosystems: Block, object, and network storage technologies.
System Networking: Navigating bonding, firewalls, bridging, switching, or MTU tuning.
Analytical Curiosity: A strong troubleshooting mindset—the ability to look into stack traces or logs, identify OS/application-level bugs, and strategically guide the customer through next steps.
Development Fundamentals: Basic programming logic in any language to help parse code and collaborate effectively with Canonical Engineering teams.
What we offer colleagues
We consider geographical location, experience, and performance in shaping compensation worldwide. We revisit compensation annually (and more often for graduates and associates) to ensure we recognise outstanding performance. In addition to base pay, we offer a performance-driven annual bonus or commission. We provide all team members with additional benefits, which reflect our values and ideals. We balance our programs to meet local needs and ensure fairness globally.
Distributed work environment with twice-yearly team sprints in person
Personal learning and development budget of USD 2,000 per year
Annual compensation review
Recognition rewards
Annual holiday leave
Maternity and paternity leave
Employee Assistance Programme
Opportunity to travel to new locations to meet colleagues
Priority Pass, and travel upgrades for long haul company events
About Canonical
Canonical is a pioneering tech firm at the forefront of the global move to open source. As the company that publishes Ubuntu, one of the most important open source projects and the platform for AI, IoT and the cloud, we are changing the world of software. We recruit on a global basis and set a very high standard for people joining the company. We expect excellence - in order to succeed, we need to be the best at what we do. Most colleagues at Canonical have worked from home since its inception in 2004. Working here is a step into the future, and will challenge you to think differently, work smarter, learn new skills, and raise your game.
Canonical is an equal opportunity employer
We are proud to foster a workplace free from discrimination. Diversity of experience, perspectives, and background create a better work environment and better products.
Whatever your identity, we will give your application fair consideration.
Location: Office Based - London, UK
This is an opportunity to kickstart your career by joining Canonical. You will be working from our Canonical London Office and will be accountable for delivering technical support to our employees and customers, as well as facilitating AV support for office conferences and events. From problem qualification to full resolution, you will own and manage your cases. When needed, you will transfer your cases to your colleagues or involve senior engineers. If you have an affinity for open source development and a passion for technology, then you will enjoy working with some of the best people in the industry at Canonical.
Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. Our customers include the world's leading public cloud and silicon providers, and industry leaders in many sectors. The company is a pioneer of global distributed collaboration, with 1100+ colleagues in 75+ countries and very few office based roles. Teams meet two to four times yearly in person, in interesting locations around the world, to align on strategy and execution.
The company is founder led, profitable and growing.
While our engineers regularly solve deeply interesting, complex technical problems - from triaging cloud environments to root-cause analysis on unseen Linux kernel crashes - this is fundamentally a role rooted in human connection. You will act as a trusted peer and technical guide to external engineering teams, translating intricate open-source challenges into clear, empathetic solutions. We are rapidly expanding and looking for brilliant problem solvers who are just as passionate about building strong, collaborative relationships with customers as they are about the next generation of Canonical solutions.
Location: Office Based in London, England.
The role entails
Empathetic Engagement:
Partner directly with customers across remote sessions, ticketing,, and live conversations to deeply understand and resolve their technical roadblocks.
Collaborative Problem Solving:
Work hand-in-hand with internal engineering teams and regional peer groups to bridge the gap between complex code fixes and real-world customer satisfaction.
True Ownership:
Manage your support cases with a strong sense of personal integrity, ensuring commitments are honored and customer expectations are communicated transparently and predictably.
Ubuntu Lifecycle Guidance:
Develop a rich understanding of the Ubuntu development process, empowering you to give customers clear, human context regarding timelines for engineering fixes.
Knowledge Advocacy:
Author and maintain accessible knowledge base articles, ensuring lessons learned are shared openly to elevate the entire open-source community.
Operational Reliability:
Participate in a regular weekend working rotation to maintain seamless, high-touch continuity of care for our global partners.
What are we looking for in you
Communication Excellence:
Exceptional written and spoken English, with a natural ability to convey technical complexity clearly, warmly, and compellingly.
The Soft-Skill Edge:
A genuine passion for helping people, paired with the emotional intelligence to navigate high-stakes technical situations with composure and empathy.
Academic Dedication:
Exceptional academic track record from both high school and university.
Educational Background:
An undergraduate degree in a technical subject or a compelling narrative about your alternative chosen path.
On-Site Technical Leadership:
Based in our state-of-the-art London, UK office, you will serve as a key technical support resource for our local teams and employees.
Driven Mindset:
A proven track record of going above-and-beyond expectations to deliver meaningful, outstanding results for teams or customers.
Linux & Cloud Familiarity:
Practical, hands-on experience supporting Linux systems, with an exposure to three or more of the following:
Virtualization & Cloud:
Using KVM or OpenStack.
Containers:
primarily Docker, LXD/LXC, or Kubernetes.
Storage Ecosystems:
Block, object, and network storage technologies.
System Networking:
Navigating bonding, firewalls, bridging, switching, or MTU tuning.
Analytical Curiosity:
A strong troubleshooting mindset—the ability to look into stack traces or logs, identify OS/application-level bugs, and strategically guide the customer through next steps.
Development Fundamentals:
Basic programming logic in any language to help parse code and collaborate effectively with Canonical Engineering teams.
What we offer colleagues
We consider geographical location, experience, and performance in shaping compensation worldwide. We revisit compensation annually (and more often for graduates and associates) to ensure we recognise outstanding performance. In addition to base pay, we offer a performance-driven annual bonus or commission. We provide all team members with additional benefits, which reflect our values and ideals. We balance our programs to meet local needs and ensure fairness globally.
Distributed work environment with twice-yearly team sprints in person
Personal learning and development budget of USD 2,000 per year
Annual compensation review
Recognition rewards
Annual holiday leave
Maternity and paternity leave
Employee Assistance Programme
Opportunity to travel to new locations to meet colleagues
Priority Pass, and travel upgrades for long haul company events
About Canonical
Canonical is a pioneering tech firm at the forefront of the global move to open source. As the company that publishes Ubuntu, one of the most important open source projects and the platform for AI, IoT and the cloud, we are changing the world of software. We recruit on a global basis and set a very high standard for people joining the company. We expect excellence - in order to succeed, we need to be the best at what we do. Most colleagues at Canonical have worked from home since its inception in 2004. Working here is a step into the future, and will challenge you to think differently, work smarter, learn new skills, and raise your game.
Canonical is an equal opportunity employer
We are proud to foster a workplace free from discrimination. Diversity of experience, perspectives, and background create a better work environment and better products.
Whatever your identity, we will give your application fair consideration.
JКомпания не указана
Управление вакансиями скоро появится
Скрытые компании и отметки о просмотре ещё не подключены.
Задачи:
— Проектировать и развивать внутреннее AI-ядро: агенты, skills, tool use, routing, orchestration.
— Строить и улучшать RAG-сценарии: retrieval, chunking, embeddings, reranking, доступ к знаниям.
— Делать reusable-компоненты и шаблоны для аналитиков: skills, коннекторы, пайплайны, reference flows.
— Интегрировать AI-платформу с внутренними системами, базами данных, API и корпоративными источниками знаний.
— Настраивать observability, tracing, evaluation и контроль качества AI-пайплайнов.
— Оптимизировать качество, latency, стоимость и устойчивость пайплайнов.
Требования:
— Практический опыт построения production RAG / agent / workflow-систем.
— Опыт создания внутренних инструментов или платформ, которыми реально пользовались аналитики или бизнес-команды.
— Умение работать на стыке engineering и enablement: собрать решение и сделать его понятным для пользователей.
— Опыт интеграции AI-пайплайнов с корпоративными источниками данных, API и внутренними системами.
— Умение разбирать сложные пользовательские сценарии и упаковывать их в reusable-механики платформы.
Технический стек:
• Python, SQL, FastAPI, API integrations, async, service-oriented development.
• LangGraph, LlamaIndex, Haystack, Semantic Kernel.
• Qdrant, pgvector, Weaviate, Milvus, OpenSearch, Elasticsearch.
• Embeddings, hybrid search, metadata filtering, reranking.
• Airflow, Prefect, Dagster, Temporal.
• Langfuse, Phoenix, OpenTelemetry (или собственные подходы к tracing / observability / eval).
• Docker, Linux, Kubernetes, CI/CD.
Условия:
— Ставка: обсуждается отдельно.
— Готовность к редким командировкам в Ереван.
— Работа в топовом финтех-направлении над уникальным AI-продуктом.
Location: Stockholm
ABOUT US:
AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL.
Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
Our customers include category-defining companies like Ramp https://modal.com/blog/how-ramp-built-a-full-context-background-coding-agent-on-modal, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.
We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.
Our team includes creators of popular open-source projects (e.g.,Seaborn https://github.com/mwaskom/seaborn,Luigi https://github.com/spotify/luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.
THE ROLE:
We’re looking for an Engineering Manager to lead a group of highly experienced engineers. This is a hands-on leadership role where you’ll spend roughly half your time on technical contribution and half on people management, depending on the need. You’ll work closely with the team to set direction, remove blockers, and foster a strong engineering culture as they tackle complex systems challenges in distributed computing, large-scale data handling, and performance optimization.
WHO YOU ARE:
We think you are an experienced engineering leader who thrives close to the work and enjoys building alongside their team when needed. You earn trust through technical depth, communicate with clarity, and help great engineers move fast and make sound decisions. You thrive in a fast paced environment, you are pragmatic, calm under pressure, and focused on impact.
REQUIREMENTS:
- At least 10 years of industry experience, including 3 years experience in a leadership role
- Experience building high-performance distributed systems at a large scale
- Strong background in cloud infrastructure
- Strong knowledge of low-level operating system foundations (Linux kernel, file systems, containers, etc.)
- Proficient in systems-level languages such as Rust, C, C++, or Java
Location: Canada; Europe; United States; United Kingdom
Workplace: Remote
WHO ARE WE?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
Why this role?
Ship state of the art models to production.
Design and implement novel research ideas.
Build elegant training/deployment pipelines.
Join us at a pivotal moment, shape what we build and wear multiple hats as an intern!
Our recruitment process will begin in the upcoming weeks, and we will be carefully reviewing applications and assessing potential candidates for our internships. Should we find a suitable match with your qualifications and our requirements, we will be in touch to discuss the opportunity further and to advance your application to the next stage
Please Note: To be eligible for this position you should be a student currently enrolled in a post-secondary program, available for a full-time 3-6 month internship, co-op, or research work term.
As a Machine Learning Intern, you will:
- Design, train and improve upon cutting-edge models.
- Help us develop new techniques to train and serve models safer, better, and faster.
- Train extremely large-scale models on massive datasets.
- Explore continual and active learning strategies for streaming data.
- Learn from experienced senior machine learning technical staff.
- Work closely with product teams to develop solutions.
You may be a good fit if you have:
- Proficiency in Python and related ML frameworks such as Tensorflow, TF-Serving, JAX, and XLA/MLIR.
- Experience using large-scale distributed training strategies.
- Familiarity with autoregressive sequence models, such as Transformers.
- Strong communication and problem-solving skills.
- A demonstrated passion for applied NLP models and products.
- Bonus: experience writing kernels for GPUs using CUDA.
- Bonus: experience training on TPUs.
- Bonus: papers at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP).
FULL-TIME EMPLOYEES AT COHERE ENJOY THESE PERKS:
- A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
- Full health and dental benefits, including a separate budget for mental health.
- RRSP matching, 401K, Pension Scheme.
- 100% Parental Leave top-up for up to 6 months, for either parent.
- Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
- 6 weeks of paid vacation (30 working days!)
- Budget for traveling to other offices if you are remote, plus an annual company offsite.
HOW AND WHERE WE WORK:
- Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
- For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
- For those not near an office: a co-working benefit so you can work alongside others in your city.
- Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form https://docs.google.com/forms/d/12a6IrLdF3kI2nonKSr4tiFuz18rLQbaeYV-JM9L4o9Q/edit, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers https://cohere.com/careers page.
Location: United Kingdom; Brazil; Ireland; Peru; Costa Rica; Latvia; Argentina; Romania; Cyprus; Portugal; Slovenia; Lithuania; South Africa; Czech Republic; Panama; Estonia; Canada; Hungary; Mexico; Poland; Spain; Bulgaria
Workplace: Remote
BUILDING THE FUTURE OF OPEN FINANCE
Payward - the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks - has spent the last 15 years building one of the most modern and globally accessible financial infrastructure platforms in the industry, built to advance an open, global financial system.
Before you apply, we encourage you to explore our culture page https://www.kraken.com/culture to understand what drives us and how we work.
THE TEAM
Founded in 2011, Kraken is one of the world's longest-standing crypto platforms, trusted by over 10 million individuals and institutions across the globe. It offers spot trading, margin, futures, staking, and OTC services, with products built for both individual investors and institutional clients.
Kraken is building a dedicated AI Compute and Infrastructure team to power the next generation of model training, inference, evaluation, and experimentation across the exchange. This team sits within engineering leadership and owns the infrastructure layer that lets Kraken run AI workloads with control, speed, reliability, and cost discipline.
The team is responsible for GPU and accelerator infrastructure, cluster operations, scheduling, model serving, observability, capacity planning, and cost-efficient compute at scale. This is the backbone that allows Kraken to train, serve, evaluate, and iterate on AI systems in-house where it matters for privacy, latency, reliability, cost, or product differentiation.
You will join a small, senior, high-impact team working directly with AI/ML researchers, platform engineers, security teams, and product teams. The mandate is simple: make Kraken's AI ambitions real by building compute infrastructure that is fast, dependable, efficient, and production-grade.
THE OPPORTUNITY
- Own and operate GPU and accelerator clusters used for training, inference, evaluation, and experimentation, including drivers, runtimes, kernels, device plugins, node configuration, scheduling primitives, and workload isolation.
- Design infrastructure that enables Kraken teams to run models locally on GPUs where it is strategically and economically preferable, reducing unnecessary dependency on external providers and containing compute costs.
- Build and improve scheduling, orchestration, placement, quota management, and utilization systems across heterogeneous accelerator environments.
- Optimize inference pipelines for latency, throughput, reliability, memory efficiency, and cost using frameworks such as vLLM, Triton Inference Server, TensorRT, or equivalent serving stacks.
- Partner with ML engineers and researchers to remove bottlenecks in training, evaluation, batch inference, online inference, deployment, and production debugging workflows.
- Build observability for GPU utilization, memory pressure, queue depth, saturation, token throughput, request latency, failed workloads, capacity pressure, and spend.
- Drive reliability, incident response, alerting, runbooks, and post-incident improvements for always-on AI compute infrastructure.
- Evaluate and integrate new hardware, cloud instance families, specialized accelerators, runtimes, schedulers, and serving frameworks as the AI infrastructure landscape evolves.
- Build tooling that makes GPU usage visible, accountable, and easier for internal teams to consume without needing to become infrastructure experts.
- Contribute to long-term architecture decisions that balance performance, cost efficiency, scalability, operational simplicity, and production safety.
WHAT YOU BRING
- 5+ years of infrastructure engineering experience, with significant time spent on GPU compute, ML infrastructure, distributed systems, high-performance computing, or large-scale production platforms.
- Hands-on experience operating GPU clusters or accelerator-backed infrastructure in production or production-like environments, including scheduling, orchestration, utilization monitoring, and cost optimization.
- Strong systems engineering fundamentals across Linux, networking, storage, containers, Kubernetes, distributed runtimes, and production debugging.
- Experience with ML serving frameworks such as vLLM, Triton Inference Server, TensorRT, TorchServe, KServe, Ray Serve, or equivalent systems.
- Proficiency in Python for infrastructure automation, tooling, debugging, integration, and operational workflows.
- Practical understanding of performance tradeoffs across batching, concurrency, memory usage, GPU utilization, model size, latency, throughput, availability, and cost.
- Track record of optimizing compute costs while maintaining clear performance, reliability, and availability expectations.
- Experience building observable systems with useful metrics, logs, traces, dashboards, alerts, and incident workflows.
- Comfortable working in high-stakes, always-on environments where uptime, throughput, correctness, and operational discipline are critical.
- Clear communicator who can translate infrastructure tradeoffs for researchers, product teams, platform engineers, security stakeholders, and engineering leadership.
NICE TO HAVES
- Experience at a frontier AI lab, hyperscaler, high-frequency trading firm, research platform, or high-scale ML organization.
- Familiarity with custom silicon or specialized accelerators such as TPUs, AWS Trainium, Gaudi, or similar platforms.
- Background in capacity planning, procurement input, reserved capacity strategy, cloud accelerator economics, or GPU fleet cost management.
- Experience with distributed training frameworks such as DeepSpeed, Megatron-LM, FSDP, Ray, or equivalent systems.
- Experience debugging CUDA, NCCL, kernel, driver, runtime, memory, networking, or low-level performance issues.
- Experience with Rust, C++, Go, CUDA, or other systems languages used for performance-critical infrastructure.
- Crypto, financial services, trading infrastructure, or security-sensitive production infrastructure experience.
Unless a specific application deadline is stated in the job posting, applications are accepted on an ongoing basis.
Please note, applicants are permitted to redact or remove information on their resume that identifies age, date of birth, or dates of attendance at or graduation from an educational institution.
We consider qualified applicants with criminal histories for employment on our team, assessing candidates in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance.
OUR COMMITMENT
Payward is powered by people from around the world and we celebrate the diverse talents, backgrounds, contributions, and unique perspectives that everyone brings to the table. We hire based on merit, seeking out people with the right abilities, knowledge, and skills for the job. We encourage you to apply for roles where you don't fully meet the listed requirements, especially if you're passionate or knowledgeable about crypto.
We may ask candidates to complete job-related skills or work-style assessments as part of our hiring process. These assessments evaluate competencies relevant to the role and are applied consistently across candidates for similar positions. Results are considered alongside experience and interviews, and are not the sole basis for any employment decision.
As an equal opportunity employer, we don't tolerate discrimination or harassment of any kind, whether based on race, ethnicity, age, gender identity, citizenship, religion, sexual orientation, disability, pregnancy, veteran status, or any other protected characteristic as outlined by federal, state, or local laws.
Stay connected
Follow us on Twitter https://twitter.com/krakenfx
Learn on the Kraken Blog https://blog.kraken.com/#:~:text=Enter%20your%20email%20address
Connect on LinkedIn https://www.linkedin.com/company/kraken-exchange/
Candidate Privacy Notice https://www.kraken.com/legal/candidate-privacy-notice
Location: Canada; England; Portugal; Spain; Italy; Germany; United States
Workplace: Remote
ABOUT DOCKER
Docker has been one of the most loved brands in developer tooling, trusted by more than 20 million monthly users and over 20 billion container image pulls. From solo founders to the world's largest companies, developers rely on Docker to build, share, and run their applications across our suite of products including Docker Desktop, Docker Hub, and Docker Scout.
We are a globally distributed, remote-first team building the tools that define how software gets built and delivered. As AI agents redefine software development, Docker is at the center of that shift, providing the sandboxed environments, verified images, and secure infrastructure that make autonomous workflows trustworthy by default.
_______________________________________________________________________
As a Senior Security Engineer embedded in the Desktop engineering team, you will own the security posture of a complex, cross-platform product that sits at the intersection of identity, OCI runtimes, and Linux kernel internals. You will be the team's primary security voice, reviewing features and code before they ship, partnering with our central security organization, and serving as the first line of triage for reported vulnerabilities.
This is a hands-on engineering role for someone who thinks in threat models and communicates clearly with both product engineers and security specialists alike.
RESPONSIBILITIES:
- Partner with engineering and product teams throughout the development lifecycle to identify security risks early, from design review through code review and release.
- Conduct threat modeling and security design reviews for new and evolving product features, with particular focus on authentication, authorization, and container runtime security.
- Serve as the team's primary liaison to the organization's security group, attending security syncs, relaying guidance, and translating central policy into practical engineering decisions.
- Act as the first point of contact for incoming vulnerability reports and CVEs: validate severity, reproduce issues, coordinate disclosure timelines, and drive remediation with the relevant engineers.
- Review Go code with a security mindset, identifying classes of issues such as privilege escalation, insecure defaults, injection risks, and improper credential handling.
- Contribute security-focused improvements directly to the codebase where appropriate.
- Develop and maintain internal security documentation, guidelines, and runbooks for the team.
- Stay current on the Linux security landscape as it pertains to containers: namespaces, cgroups, seccomp, AppArmor, capabilities, and the evolving OCI ecosystem.
- This role may require participation in an on-call rotation to provide support outside of standard business hours, including evenings, weekends, and holidays, as needed.
QUALIFICATIONS:
- 6+ years of experience in security engineering, application security, or a closely related discipline, with a track record at senior or staff level.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- Strong proficiency in Go, with the ability to review and contribute to production-grade code.
- Deep understanding of Linux fundamentals relevant to container security: namespaces, cgroups, capabilities, seccomp profiles, AppArmor/SELinux, rootless containers, and privilege boundaries.
- Solid grasp of OCI specifications and container runtime security (e.g. runc, containerd, BuildKit).
- Hands-on experience with identity and access management concepts: OAuth 2.0, OIDC, token handling, and auth flows in desktop or cloud-adjacent contexts.
- Experience performing security design reviews, threat modeling, and participating in secure development workflows.
- Familiarity with vulnerability management processes: CVE triage, CVSS scoring, coordinated disclosure, and working with external reporters.
- Strong written and verbal communication skills; comfortable bridging the gap between a dedicated security team and a product engineering team.
WHAT TO EXPECT
FIRST 30 DAYS
You will onboard into the team and get hands-on with the Docker Desktop codebase, architecture, and development workflow. You will meet your counterparts in the central security organization and learn how vulnerability reports are currently handled. The goal is to listen, ask questions, and build a clear picture of the product's current security posture, not to change anything yet.
FIRST 90 DAYS
You will be an active participant in design and code reviews, bringing a security lens to features in flight. You will have taken ownership of the vulnerability intake process, handling your first end-to-end triage cycles with minimal guidance. You will have a working relationship with the engineers on the team and a growing sense of where the most meaningful security investments should be made.
ONE YEAR OUTLOOK (FIRST YEAR)
You will be the team's trusted authority on product security. You will have driven meaningful improvements to how the team approaches security across the development lifecycle, whether that's better threat modeling practices, improved auth flows, stronger container isolation defaults, or reduced time-to-remediation for reported issues. you will be a known presence in the broader security organization, and your work will be directly visible in the security and resilience of a product used by millions of developers every day.
Docker considers visa sponsorship on a case-by-case basis based on business needs.
Compensation & Equity
Canada: CA$271,150 – CA$434,000 + equity
United States: $194,150 – $312,950 + equity
EU: €113,860 – €186,780 + equity
______________________________________________________________________
POSTING INFORMATION
- Open vacancy: This posting is for an existing open role.
- AI in hiring: Docker may use AI-assisted tools during our recruiting process.
- Interview recordings: Candidates will be invited to opt in to interview recordings to support interviewer calibration and consistent evaluations. Recordings are optional and require explicit consent.
______________________________________________________________________
PERKS & BENEFITS
- Remote-first by design – Work from your home, with offices in Seattle and Paris for connection and collaboration.
- Flexibility that fits your life – We trust you to manage your schedule while delivering great work.
- Time to recharge – Generous PTO, designated quarterly Whaleness Days, and a designated end-of-year Whaleness break.
- Home office support – Set up your workspace for comfort and success.
- Technology stipend – Equivalent to US$100 net per month to help support your work.
- Learning & development – Annual stipend for conferences, courses, certifications, and continued learning.
- Parental leave – 16 weeks of paid parental leave after six months of employment.
- Equity for all full-time employees – Share in Docker's long-term success as we continue to grow.
- Comprehensive benefits – Medical, retirement, and paid holidays vary by country.
- Docker swag – Because representing the whale never gets old.
Docker is proud to be an equal opportunity employer. We are committed to building a team that reflects a broad range of backgrounds, experiences, and perspectives. We believe diverse teams build better products, make better decisions, and better serve our global community.
#LI-REMOTE
Location: New York
ABOUT US:
AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL.
Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
Our customers include category-defining companies like Ramp https://modal.com/blog/how-ramp-built-a-full-context-background-coding-agent-on-modal, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.
We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.
Our team includes creators of popular open-source projects (e.g.,Seaborn https://github.com/mwaskom/seaborn,Luigi https://github.com/spotify/luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.
THE ROLE:
We’re looking for an Infrastructure Security Engineer to design and secure the core systems that power our platform. This role focuses on building security directly into our infrastructure—from container isolation and orchestration to identity and secrets management in a multi-tenant, cloud-native environment.
You’ll work closely with engineering teams to define secure primitives and ensure our platform is resilient, scalable, and trustworthy by design.
This is a hands-on, deeply technical role focused on real systems, not compliance or policy.
WHAT YOU'LL DO:
Platform & Runtime Security
- Design and improve isolation mechanisms for multi-tenant workloads (containers, sandboxing, execution environments)
- Strengthen boundaries between customers, workloads, and internal systems
- Identify and mitigate risks in distributed, dynamic compute environments
Container & Orchestration Security
- Secure and harden containerized workloads and orchestration systems (e.g., Kubernetes or similar)
- Improve workload isolation, scheduling boundaries, and runtime protections
- Evaluate tradeoffs in multi-tenant execution models
Identity & Access Management
- Design and improve authentication and authorization systems across services
- Implement strong service-to-service identity and least-privilege access patterns
- Improve access controls across infrastructure and internal systems
Secrets & Key Management
- Build and maintain systems for securely managing secrets, tokens, and credentials
- Improve rotation, auditing, and access controls
- Reduce secret sprawl and integrate secure patterns into developer workflows
Cloud & Infrastructure Security
- Secure cloud environments across providers (AWS, GCP, etc.) with a focus on consistency and portability
- Improve network boundaries, service segmentation, and access controls
- Embed security into infrastructure-as-code and deployment systems
Engineering Partnership
- Work closely with product and infrastructure teams to design secure systems from the ground up
- Review architecture and code for security risks and provide actionable guidance
- Identify patterns in risks and drive cross-cutting improvements
REQUIREMENTS:
Core Experience
- Experience securing cloud-native infrastructure and distributed systems in production
- Background in infrastructure, backend, or security engineering
- Experience working in multi-tenant or high-scale environments
Technical Depth
- Strong understanding of containerization and orchestration systems (e.g., Kubernetes or similar)
- Experience designing or securing isolation mechanisms in multi-tenant systems
- Solid understanding of authentication, authorization, and service identity models
- Experience with secrets management and secure handling of credentials
- Strong foundation in networking concepts (segmentation, service communication, access boundaries)
Mindset
- Builder mentality, you design and implement, not just review
- Pragmatic approach to security in fast-moving environments
- Comfortable working deeply with engineers and influencing system design
PREFERRED QUALIFICATIONS:
- Experience with sandboxing or runtime isolation technologies (e.g., gVisor, Firecracker, seccomp, or similar)
- Familiarity with kernel-level or low-level isolation primitives
- Experience securing Kubernetes or similar orchestration systems in production
- Background in developer infrastructure, compute platforms, or multi-tenant systems
Location: New York; San Francisco
ABOUT US:
AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL.
Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
Our customers include category-defining companies like Ramp https://modal.com/blog/how-ramp-built-a-full-context-background-coding-agent-on-modal, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.
We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.
Our team includes creators of popular open-source projects (e.g.,Seaborn https://github.com/mwaskom/seaborn,Luigi https://github.com/spotify/luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.
THE ROLE:
We are looking for strong engineers with experience in making ML systems performant at scale. If you are interested in contributing to open-source projects and Modal’s container runtime to push language and diffusion models towards higher throughput and lower latency, we’d love to hear from you!
REQUIREMENTS:
- 5+ years of experience writing high-quality, high-performance code.
- Experience working with torch, high-level ML frameworks, and inference engines (vLLM or TensorRT).
- Familiarity with Nvidia GPU architecture and CUDA.
- Experience with ML performance engineering (tell us a story about boosting GPU performance — debugging SM occupancy issues, rewriting an algorithm to be compute-bound, eliminating host overhead, etc).
- Nice-to-have: familiarity with low-level operating system foundations (Linux kernel, file systems, containers, etc).
Location: San Francisco
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
We are looking for an engineer with strong experience in machine learning and solid foundations in math and computer science to join our growing Post-Training team at Baseten.
THE ROLE
Custom models are instrumental to the success of Baseten customers. By inference volume, the overwhelming majority of traffic at Baseten is to and from models that have been post-trained in some way, whether that be through reinforcement learning, supervised finetuning, a recent technique from the literature, or an in-house research technique from Baseten. The Post-Training team is responsible for the success of our customers’ post-trained models, and we employ a wide array of techniques to produce models that are more efficient and higher quality than even the biggest closed source models for the customer’s specific needs.
Your role as a research engineer is to build the in-house tooling to support all of this. We care about training a wide spectrum of different model architectures with a variety of techniques efficiently and at scale. At times this involves zooming deep into a particular technical topic, but more often it involves working across the stack as a whole - systems-level concepts like Kubernetes, cgroups, storage systems, and networking topologies, as well as PyTorch distributed tensor computation, and GPU kernels.
The Manifesto: https://labs.baseten.co/manifesto
RECENT RESEARCH
- Dense, on-policy or both? https://www.baseten.co/research/dense-on-policy-or-both/
- Repeated kv cache for long-running agents https://www.baseten.co/research/repeated-kv-cache-for-long-running-agents/
- Distillation without the dark – replicating black-box on-policy distillation on Baseten https://www.baseten.co/research/distillation-without-the-dark/
We don’t have a rigid set of skills, but here’s some of what we’re looking for:
- A deep understanding of modern ML techniques and tools for training transformers
- Advanced experience in a tensor/array computation library like PyTorch, TensorFlow, Jax, or similar
- A detailed understanding of transformer training parallelism strategies like data parallelism, sharded data parallelism, tensor parallelism, pipeline parallelism, context parallelism
- The experience and knowledge to profile and improve the performance of a distributed GPU program in PyTorch or a similar library
- The ability to perform roofline analysis on a transformer training setup
- A willingness to dive into messy problems, work with researchers, derive specifications by asking important questions, and execute
- Familiarity with HPC and distributed computing platforms like Slurm, Ray, Kubernetes, and Dask
- Familiarity with cluster networking technology like Infiniband, RoCE, GPUDirect
- Solid fundamentals in operating systems concepts like processes, files, kernel drivers, containerization, and networking protocols
- A sense of creativity and willingness to ask difficult questions about our approach, assumptions, and tooling choices
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Задачи:
— Написание модуля ядра Linux для реализации функционала управления файлами/процессами.
— Переписывание системных вызовов и API под Linux.
— Устранение зависимостей от Windows-драйверов.
— Минимизация накладных расходов драйвера.
— Исправление багов, связанных с производительностью и безопасностью.
— Работа с инструментами профилирования (perf, strace).
— Настройка взаимодействия драйвера с клиентскими модулями.
— Тестирование функционала вместе с Java и аналитиком.
Требования:
— Глубокие знания POSIX API и системных вызовов Linux.
— Опыт работы с файловыми системами, файловыми дескрипторами, mmap, epoll/inotify.
— Работа с процессами, потоками, IPC (Inter-Process Communication).
— Опыт создания модулей ядра Linux (Kernel Modules) для управления файлами и процессами.
— Знание структуры VFS (Virtual File System) в Linux.
— Умение работать с системными хуками (например, ptrace, seccomp).
— Навыки профилирования и оптимизации кода для минимизации накладных расходов.
— Умение работать с GDB, perf, strace и системными логами.
— Опыт работы с Makefile, CMake.
— Знание Git и CI/CD систем.
— Понимание безопасности: учет уязвимостей и защита данных на уровне драйверов.
Условия:
— Удаленный формат работы над интересным и сложным проектом.
Location: San Francisco; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
At Baseten, we are building the global operating system for distributed, heterogeneous AI hardware. We believe that as LLM and multi-modal workloads scale, the network is the computer. We are looking for foundational engineers to lead our GPU Networking efforts, making RDMA a first-class building block in our infrastructure and unlocking the next generation of distributed inference optimizations.
Networking and compute are no longer separate disciplines; they are converging. The massive throughput of H100, B200, and NVL72 architectures enables and demands a new approach where communication is co-optimized alongside computation. We are entering an era where the network is an active accelerator, leveraging smart hardware offloads and direct interconnects to ensure that data movement operates at wire-speed.
In this role, you will go beyond network configuration to architect the software fabric that unifies thousands of GPUs into a cohesive operating system. While you will leverage the best of the open-source ecosystem, you won't be limited by it. Where off-the-shelf solutions stop, you will build from scratch, engineering the primitives required to co-optimize communication and compute for Disaggregated Serving, Wide Expert Parallelism (WideEP), and lightening cold starts.
RESPONSIBILITIES
- Make RDMA First-Class: You will work on integrating RDMA/RoCE/InfiniBand capabilities directly into our inference stack, helping us move beyond TCP/IP to unlock order-of-magnitude improvements in bandwidth and latency.
- Optimize Distributed Inference: You will implement and tune the networking layers necessary for efficient Disaggregated KV Cache Offload and WideEP, ensuring seamless communication across NVLink and InfiniBand for our MoE models.
- Enable Serverless-Grade Startup Speeds for LLMs: You will work deeply with checkpointing and storage mechanisms to enable sub-10-second startup for trillion-parameter models.
- Deep-Dive into Hardware: You will characterize and validate networking performance on bleeding-edge clusters (H100/H200, B200/B300, GB200/300 NVL72), writing the acceptance tests that ensure our hardware delivers peak achievable throughput and minimal latency.
- Build Observability: You will design the tools that let us visualize packet flow, congestion, and effective bandwidth across the GPU interconnects, helping us diagnose complex distributed system behaviors.
- Optimize Kernels: You will work with communication libraries (NCCL, NVSHMEM) and potentially write custom communication kernels to overlap compute and data transfer.
REQUIREMENTS
- You have deep experience with high-performance networking protocols (InfiniBand, RoCE v2) and understand the physics of data movement.
- You are fluent in C++ or Python, with the ability to bridge the gap between high-level logic and hardware. You have a deep understanding of the memory hierarchy in modern NVIDIA architectures (H100/Blackwell) and know how to optimize for it.
- You like going deep. You aren't afraid to dive into TensorRT-LLM source code, write custom C++ / Python bindings, or debug NVLink topology issues.
- You know when to use an off-the-shelf solution and when we need to build a custom solution because the upstream tools (like standard Kubernetes networking) are too slow for our needs.
NICE TO HAVE
- Deep knowledge of NCCL, NVSHMEM, and UCX.
- Experience with Rust for systems-level or performance-critical networking code is a strong plus
- Experience with GPUDirect Storage (GDS) or high-performance filesystems like Weka or 3FS.
- Familiarity with TensorRT-LLM, vLLM, or SGLang.
- Experience running low-level benchmarks to "qualify" new hardware clusters.
THE TEAM
- Bleeding Edge Hardware: We are preparing to bring Blackwell (B200/B300) and then Rubin architectures online. You will be one of the first engineers in the industry optimizing networking for NVL72/GB300 racks.
- We go deep: We operate at every depth. Whether it’s tuning hardware interconnects, writing custom communication kernels, or designing distributed inference strategies, we work across the entire stack to deliver performance that goes far and beyond.
- High Impact: The networking optimizations you build will directly enable features that no one else in the industry has fully mastered yet, like seamless multi-node WideEP and instant model hydration.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: Home based - EMEA
Canonical is a leading provider of open-source software and operating systems for global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. Our customers include the world's leading public cloud and silicon providers, and industry leaders in many sectors. The company is a pioneer of global distributed collaboration, with 1200+ colleagues in more than 80 countries and very few office-based roles. Teams meet two to four times yearly in person, in interesting locations around the world, to align on strategy and execution.
The company is founder led, profitable and growing.
We are hiring an
Engineering Director
, who strives for taking ownership of the development and operations of internal software products serving Canonical business and a popular security solution Livepatch. A successful candidate has a track record of delivering full-stack software services, adheres to high engineering quality standards, and continuously develops their skills as well as skills of their direct reports. This is an exciting opportunity to work with highly enthusiastic people on exciting innovative engineering solutions supporting Canonical's growth and learn a lot about engineering for the business.
The engineering director will lead the Commercial Systems unit that is conceived as three engineering teams that closely collaborate with other engineering and business teams at Canonical. Services designed, developed, and operated by the Commercial Systems unit are at the heart of Canonical business. We are looking for a software engineering director to oversee the three software teams led by software engineering managers.
The
Billing
team designs, develops, and operates a Golang service that provides a standardized and scalable capability to turn metrics into billable amounts, enable customers to see their current spend with Canonical at any time, and ensure accurate, reliable, and timely billing. The service further integrates with other engineering, business and payment systems.
The
Contracts
team designs, develops, and operates a Golang service that will become the single source of truth for all contracts with all customers. The service provides a standardized CPQ capability and stores signed contracts in a structured format. The service further integrates with other engineering and business systems including a CRM system and an accounting system.
The
Livepatch
team designs and develops a service for the delivery of Linux kernel patches to shrink the exploit window for critical and high severity Linux kernel vulnerabilities, by patching the Linux kernel between security maintenance windows, while the system runs. The engineering team behind this product develops Golang based client and backend components, while another Canonical team, the Kernel team, develops the security patches.
Location
: This role will be based remotely in the EMEA region.
The role entails
Leading multiple teams of engineers, ranging from graduates to seniors
Developing your engineering managers to maintain Canonical culture in their teams
Developing and evangelize great engineering practices and processes in the teams
Setting and implementing solid performance management with performance goals and objectives with your direct reports and teams
Identifying and measuring indicators of team health, and take action where needed
Being accountable for the product development roadmaps in the teams
Being an active part of the Commercial Systems leadership team, collaborating with other leaders
Expanding your teams by hiring great talent
Collaborating with stakeholders and product users
What we are looking for in you
Exceptional academic track record from both high school and university
Undergraduate degree in a technical subject or a compelling narrative about your alternative chosen path
Proven ability to drive multiple teams or large teams of software engineers to deliver outstanding results
Engineering experience in at least one of the following areas: Golang, Python, Java, or distributed integrations
Track record of going above-and-beyond expectations to achieve outstanding results
Professional written and spoken English with excellent presentation skills
Result-oriented, with a personal drive to meet commitments
Ability to travel internationally twice a year, for company events up to two weeks long
Nice-to-have skills
Performance engineering and DevOps/SRE experience
Experience with accounting, sales, sales operations, or other business roles
What we offer colleagues
We consider geographical location, experience, and performance in shaping compensation worldwide. We revisit compensation annually (and more often for graduates and associates) to ensure we recognize outstanding performance. In addition to base pay, we offer a performance-driven annual bonus or commission. We provide all team members with additional benefits, which reflect our values and ideals. We balance our programs to meet local needs and ensure fairness globally.
Distributed work environment with twice-yearly team sprints in person
Personal learning and development budget of USD 2,000 per year
Annual compensation review
Recognition rewards
Annual holiday leave
Maternity and paternity leave
Employee Assistance Program
Opportunity to travel to new locations to meet colleagues
Priority Pass, and travel upgrades for long haul company events
About Canonical
Canonical is a pioneering tech firm at the forefront of the global move to open source. As the company that publishes Ubuntu, one of the most important open source projects and the platform for AI, IoT and the cloud, we are changing the world of software. We recruit on a global basis and set a very high standard for people joining the company. We expect excellence - in order to succeed, we need to be the best at what we do. Most colleagues at Canonical have worked from home since its inception in 2004. Working here is a step into the future, and will challenge you to think differently, work smarter, learn new skills, and raise your game.
Canonical is an equal opportunity employer
We are proud to foster a workplace free from discrimination. Diversity of experience, perspectives, and background create a better work environment and better products.
Whatever your identity, we will give your application fair consideration.
#LI-remote
Location: Office Based - London, UK
This is an opportunity to kickstart your career by joining Canonical. You will be working from our Canonical London Office and will be accountable for delivering technical support to our employees and customers, as well as facilitating AV support for office conferences and events. From problem qualification to full resolution, you will own and manage your cases. When needed, you will transfer your cases to your colleagues or involve senior engineers. If you have an affinity for open source development and a passion for technology, then you will enjoy working with some of the best people in the industry at Canonical.
Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. Our customers include the world's leading public cloud and silicon providers, and industry leaders in many sectors. The company is a pioneer of global distributed collaboration, with 1100+ colleagues in 75+ countries and very few office based roles. Teams meet two to four times yearly in person, in interesting locations around the world, to align on strategy and execution.
The company is founder led, profitable and growing.
While our engineers regularly solve deeply interesting, complex technical problems - from triaging cloud environments to root-cause analysis on unseen Linux kernel crashes - this is fundamentally a role rooted in human connection. You will act as a trusted peer and technical guide to external engineering teams, translating intricate open-source challenges into clear, empathetic solutions. We are rapidly expanding and looking for brilliant problem solvers who are just as passionate about building strong, collaborative relationships with customers as they are about the next generation of Canonical solutions.
Location: Office Based in London, England.
The role entails
Empathetic Engagement:
Partner directly with customers across remote sessions, ticketing,, and live conversations to deeply understand and resolve their technical roadblocks.
Collaborative Problem Solving:
Work hand-in-hand with internal engineering teams and regional peer groups to bridge the gap between complex code fixes and real-world customer satisfaction.
True Ownership:
Manage your support cases with a strong sense of personal integrity, ensuring commitments are honored and customer expectations are communicated transparently and predictably.
Ubuntu Lifecycle Guidance:
Develop a rich understanding of the Ubuntu development process, empowering you to give customers clear, human context regarding timelines for engineering fixes.
Knowledge Advocacy:
Author and maintain accessible knowledge base articles, ensuring lessons learned are shared openly to elevate the entire open-source community.
Operational Reliability:
Participate in a regular weekend working rotation to maintain seamless, high-touch continuity of care for our global partners.
What are we looking for in you
Communication Excellence:
Exceptional written and spoken English, with a natural ability to convey technical complexity clearly, warmly, and compellingly.
The Soft-Skill Edge:
A genuine passion for helping people, paired with the emotional intelligence to navigate high-stakes technical situations with composure and empathy.
Academic Dedication:
Exceptional academic track record from both high school and university.
Educational Background:
An undergraduate degree in a technical subject or a compelling narrative about your alternative chosen path.
On-Site Technical Leadership:
Based in our state-of-the-art London, UK office, you will serve as a key technical support resource for our local teams and employees.
Driven Mindset:
A proven track record of going above-and-beyond expectations to deliver meaningful, outstanding results for teams or customers.
Linux & Cloud Familiarity:
Practical, hands-on experience supporting Linux systems, with an exposure to three or more of the following:
Virtualization & Cloud:
Using KVM or OpenStack.
Containers:
primarily Docker, LXD/LXC, or Kubernetes.
Storage Ecosystems:
Block, object, and network storage technologies.
System Networking:
Navigating bonding, firewalls, bridging, switching, or MTU tuning.
Analytical Curiosity:
A strong troubleshooting mindset—the ability to look into stack traces or logs, identify OS/application-level bugs, and strategically guide the customer through next steps.
Development Fundamentals:
Basic programming logic in any language to help parse code and collaborate effectively with Canonical Engineering teams.
What we offer colleagues
We consider geographical location, experience, and performance in shaping compensation worldwide. We revisit compensation annually (and more often for graduates and associates) to ensure we recognise outstanding performance. In addition to base pay, we offer a performance-driven annual bonus or commission. We provide all team members with additional benefits, which reflect our values and ideals. We balance our programs to meet local needs and ensure fairness globally.
Distributed work environment with twice-yearly team sprints in person
Personal learning and development budget of USD 2,000 per year
Annual compensation review
Recognition rewards
Annual holiday leave
Maternity and paternity leave
Employee Assistance Programme
Opportunity to travel to new locations to meet colleagues
Priority Pass, and travel upgrades for long haul company events
About Canonical
Canonical is a pioneering tech firm at the forefront of the global move to open source. As the company that publishes Ubuntu, one of the most important open source projects and the platform for AI, IoT and the cloud, we are changing the world of software. We recruit on a global basis and set a very high standard for people joining the company. We expect excellence - in order to succeed, we need to be the best at what we do. Most colleagues at Canonical have worked from home since its inception in 2004. Working here is a step into the future, and will challenge you to think differently, work smarter, learn new skills, and raise your game.
Canonical is an equal opportunity employer
We are proud to foster a workplace free from discrimination. Diversity of experience, perspectives, and background create a better work environment and better products.
Whatever your identity, we will give your application fair consideration.
Location: New York
ABOUT US:
AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL.
Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
Our customers include category-defining companies like Ramp https://modal.com/blog/how-ramp-built-a-full-context-background-coding-agent-on-modal, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.
We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.
Our team includes creators of popular open-source projects (e.g.,Seaborn https://github.com/mwaskom/seaborn,Luigi https://github.com/spotify/luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.
THE ROLE:
We're looking for an Engineering Manager to lead a team of highly experienced engineers building the infrastructure that powers Modal's serverless GPU platform. This is a hands-on leadership role — expect to split your time between technical contribution and people management depending on what the team needs. You'll set direction, remove blockers, and build a strong engineering culture as your team tackles hard problems in distributed computing, large-scale data handling, and performance optimization.
WHO YOU ARE:
You're an experienced engineering leader who stays close to the work and builds alongside your team when it counts. You earn trust through technical depth, not title. You communicate clearly, help strong engineers move fast without cutting corners, and stay calm and pragmatic under pressure. You care as much about how your team gets to an answer as the answer itself.
RESPONSIBILITIES:
Team
- Recruit, hire, and grow a high-performing team of cloud platform engineers; run regular 1:1s focused on coaching, feedback, and career growth.
- Set clear performance expectations, hold a high bar, and build an environment where engineers do their best work.
- Foster a culture of ownership, accountability, and continuous improvement.
Technical Direction
- Drive day-to-day technical decisions through design reviews, code reviews, and architectural discussions.
- Translate the infrastructure roadmap into clear team priorities and milestones, and hold execution against them.
- Establish standards for reliability, performance, and operational excellence; ensure the team owns projects end-to-end, from spec through production.
- Push for good judgment on tooling and architecture, with a bias against unnecessary complexity.
Cross-Functional & Incident Leadership
- Partner with product and engineering to align infrastructure work with business priorities; represent your team's progress, capacity, and tradeoffs clearly to leadership.
- Serve as the escalation point for major incidents; drive resolution with urgency and ensure the team learns systematically, feeding those learnings back into infrastructure improvements.
REQUIREMENTS:
- 10+ years of industry experience, including 3+ years in a leadership role
- Track record building high-performance distributed systems at scale
- Strong background in cloud infrastructure
- Deep knowledge of low-level OS foundations (Linux kernel, file systems, containers, etc.)
- Proficiency in a systems-level language (Rust, C, C++, or Java)
УдалённоRemote: United States; San Francisco HQ; Remote: Canada
170 000 – 290 000 $
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.