Location: San Francisco; New York
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
Product at Baseten is a nascent function. Our company today has a strong engineering culture, is heavily customer obsessed, and moves fast. We're building the product function now, and you'd be one of the first people who will help define it. You'll work directly with our founders and with some of the best systems and infrastructure engineers in the world, and you'll set the standard for building great AI infrastructure. PMs at Baseten don't sit above engineers. You earn ownership by being technical, finding the truth in front of customers, building great cross-functional relationships, and shipping great product experiences.
Getting a model into production still takes real expertise: choosing a serving engine, sizing hardware, tuning it, wiring it into an app. We want a developer to go from "it runs on my laptop" to "it's serving production traffic" in minutes, on their own. You'll own the entire experience a developer touches to deploy and iterate: the CLI and SDKs, the console, onboarding, model discovery, deployment configuration, Truss, and the increasingly agent-driven ways developers build. Your job is to make Baseten synonymous with great DevEx and make it effortless for far more developers to self-serve deploy models on Baseten than can today.
This role fits someone who gets technical by instinct and does whatever it takes to ship for customers, not only strategy, UX, or docs. You'll define the design system and the patterns from scratch rather than work inside ones someone else built, and you're obsessed with improving your product craft with AI.
EXAMPLE INITIATIVES
Take a look at these blog posts written by members of our Product and Engineering teams:
- Building multi-component AI workflows at scale with Chains https://www.baseten.co/blog/baseten-chains-explained/
- Announcing Baseten for Model Labs https://www.baseten.co/blog/announcing-baseten-for-model-labs/
- Introducing canary deployments on Baseten https://www.baseten.co/blog/canary-deployments-on-baseten/
RESPONSIBILITIES
- Collapse time to production, taking a developer from first sign-up to a running, maintained production deployment and driving down the time it takes to get there.
- Make the CLI and SDKs the primary way developers and their AI agents build on Baseten, converging the authoring surfaces (CLI, console, Truss, config.yml, model.py, chains.py) into one coherent path.
- Make a developer's first run effortless across onboarding, model discovery and deploy via the Model Library, and a first deploy where errors surface clearly and builds show progress.
- Own the deployment lifecycle that lets teams ship safely, including environment promotion from dev to staging to prod, version history, an artifact and model registry, reproducible deployments, and the progressive delivery controls developers set and read: canary, shadow, A/B, scheduled promotion, and one-gesture rollback.
- Define how developers compose multi-model apps through Chains and the DevEx for developers building multi-modal agents and applications.
- Grow self-serve deployment across FDEs and customers by living in customer conversations and turning deploy-and-operate friction into roadmap, so work that needs an FDE today becomes something a developer does alone.
REQUIREMENTS
- 5+ years building developer-facing or technical products, as a product manager or as a product-minded engineer.
- Built dev tools as an engineer before becoming a PM, shipping SDKs, CLIs, APIs, or platform surfaces with your own hands.
- Proof of dev tooling and dev products you've shipped and take pride in.
- Genuine taste for developer experience across both local (CLI) and UI, with a specific example of where you made something complex feel simple.
- Strong opinions on CLI, API-first, and agent-first design, treating the coding agent as a first-class user rather than a feature.
- Technical enough to earn engineers' trust and reason about what's under the hood, because you've been under it.
- A rigorous researcher who lets customer reality drive the call, and a relentless shipper
NICE TO HAVE
- Experience with ML infrastructure, developer tools, or API products.
- You've deployed and served models yourself.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
At Baseten, we’re looking for a Technical Program Manager to drive our most complex, cross-cutting infrastructure programs. This role will operate across all domains of AI infrastructure, from the GPUs up to the multi-cluster orchestration layer.
This is an execution-first role. The work is less about owning a single system and more about imposing order on ambiguity: standing up the right structures, driving decisions to closure, and making sure nothing falls through the cracks across dozens of stakeholders. If you take satisfaction in turning a chaotic, half-defined initiative into a predictable, well-governed program, this role is for you.
RESPONSIBILITIES
- Own complex migrations end to end. Lead large-scale infrastructure migrations across teams and domains. This will involve scoping the work, sequencing dependencies, managing risk, and driving them to completion without surprises.
- Drive process across infrastructure. Establish and run the operating rhythms that keep programs healthy: planning cadences, status reporting, decision logs, risk reviews, and escalation paths. Make the process light enough that teams adopt it and rigorous enough that it actually works.
- Help managers build the right structures. Partner with engineering managers and leads to design the team structures, ownership boundaries, and working models a program needs to succeed. Spot gaps in accountability before they become problems.
- Own follow-ups relentlessly. Be the person who tracks every open item, owns the action register, and closes loops. Drive decisions and unblockers to resolution rather than letting them drift.
- Create clarity from ambiguity. Take loosely defined goals and turn them into scoped, sequenced, resourced plans with clear owners and measurable milestones.
- Manage risk and dependencies. Maintain a clear-eyed view of cross-team dependencies and risks; surface them early, drive mitigation, and keep leadership informed with honest, signal-rich updates.
- Communicate up, down, and across. Translate between deeply technical teams and senior leadership. Run effective program reviews and write the kind of crisp status that lets busy people make fast decisions.
REQUIREMENTS
- 3+ years of technical program management experience, with a track record of delivering large, cross-team infrastructure or platform programs.
- Demonstrated ownership of complex migrations or comparable multi-domain initiatives from inception through completion.
- Strong execution discipline: you build the structures, cadences, and tracking that keep programs on the rails, and you hold the line on follow-through.
- Comfort operating across multiple infrastructure domains. You don't need to be the deepest expert in any one, but you can engage credibly with engineers on compute, storage, networking, and data.
- Proven ability to influence without authority, aligning teams and managers who don't report to you around shared plans and commitments.
- Excellent written and verbal communication; you can make complex, technical programs legible to any audience.
- A bias toward closure: you're uncomfortable with open loops and you drive things to done.
NICE TO HAVE
- Experience designing team structures or operating models alongside engineering leadership.
- Experience with AI models, their use, and how they operate at the infrastructure level.
- Background in or exposure to software engineering, SRE, or infrastructure operations.
- Familiarity with the tooling that supports program execution at scale (e.g., issue tracking, planning, and reporting systems).
WHAT SUCCESS LOOKS LIKE
- In your first few months, you'll have taken ownership of one or more in-flight programs, established the operating rhythm they were missing, and built the trust that makes teams want you in the room.
- Within a year, the programs you run are the ones leadership doesn't worry about, because the structure is clear, the risks are visible early, and the follow-ups always close.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
As the Engineering Manager for Baseten's Cloud Platform team, you will directly manage a team of cloud platform engineers responsible for building the systems and processes that keep our infrastructure scalable, reliable, and efficient — from automated deployments and monitoring to performance optimization and incident response.
You are a people-first leader with a strong cloud infrastructure background. You set a high bar for reliability and operational excellence, engage credibly in technical discussions and code reviews, and know how to build a culture of ownership and accountability. You'll spend most of your time close to the work: unblocking your team, shaping technical direction on day-to-day decisions, and developing your engineers. At Baseten, we work closely with our users to understand their struggles operationalizing ML — you'll keep your team connected to that mission and translate user learnings into better infrastructure.
RESPONSIBILITIES
- Recruit, hire, and grow a high-performing team of cloud platform engineers; provide ongoing coaching, feedback, and career development through regular 1:1s.
- Set clear performance expectations, hold a high bar, and create an environment where engineers do their best work.
- Foster a culture of ownership, accountability, and continuous improvement.
- Drive day-to-day technical decisions through design reviews, code reviews, and architectural discussions; translate the infrastructure roadmap into clear team priorities and milestones, and hold execution against them.
- Establish standards and best practices for reliability, performance, and operational excellence; ensure the team owns projects end-to-end, from specification through production.
- Exercise and encourage good judgment on tooling and architectural tradeoffs, with a bias against unnecessary complexity.
- Partner with product and engineering teams to align infrastructure work with business priorities; represent your team's progress, capacity, and technical tradeoffs clearly to leadership.
- Serve as the escalation point for major incidents; drive resolution with urgency, ensure the team learns systematically, and stay connected to users so those learnings feed back into infrastructure improvements.
REQUIREMENTS
- Proven experience directly managing engineers in a cloud infrastructure, platform engineering, or SRE context (not managing managers).
- Extensive hands-on experience with Kubernetes, with the ability to engage credibly in architectural discussions and code reviews.
- Strong background building and maintaining scalable, production infrastructure.
- Familiarity with infrastructure-as-code tools (e.g., Terraform, CloudFormation, Pulumi) and CI/CD tooling (e.g., GitHub Actions, GitLab CI, CircleCI, Jenkins).
- Demonstrated ability to drive projects end-to-end — from specification to execution — and coach your team to do the same.
- Strong written and verbal communication skills; able to influence across teams without direct authority.
- Track record of recruiting and growing engineering talent.
- Openness to learning about ML infrastructure; prior machine learning experience is not required.
NICE TO HAVE
- Experience with OSS observability tooling (Prometheus, ELK stack, Grafana, OpenTelemetry).
- Background in multi-cloud environments or GPU infrastructure.
- Experience building and managing on-call rotations and incident response processes.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: New York; San Francisco
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
We're looking for an experienced recruiter to help support our scaling sales, marketing and revenue operations teams. You'll work closely with hiring managers and Sales leadership to build out the team, with a focus on Account Executives. You'll own ambitious hiring goals and get deep on our product and the AI infrastructure space, so you can speak credibly to candidates about what we build and why it matters.
RESPONSIBILITIES
- Full-cycle recruiting: Own Sales hiring goals and process, from role kickoff through offer acceptance
- Sourcing: Work with hiring managers to define what "excellent" looks like for each role, then build pipelines through targeted sourcing and creative outreach
- Candidate experience: Partner closely with recruiting coordination on delivering an exceptional candidate experience, from first reach out to offer close
- Process improvement: Refine and scale our recruiting process to move faster while keeping a high bar
REQUIREMENTS
- 3+ years of full-cycle recruiting experience, ideally at a fast-growing startup with big headcount goals
- Proven track record of high-volume sales hiring, especially Account Executives
- Experience hiring technical sellers, ideally for developer tools, infrastructure, or AI
- Ownership mindset: you take responsibility for a team's hiring goals and fix what's slowing you down
- Strong organization, with the ability to run multiple searches at once
- Clear, direct written and verbal communication
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; Remote; Toronto; New York; Montreal
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
As a Site Reliability Engineer at Baseten, you'll define and codify the gold standards of day 2 operations for our ML infrastructure platform. You'll envision and build robust systems, processes, automations, and observability tooling that keep our platform reliable at scale — and that empower the broader organization to operate confidently.
You'll work closely with engineering, forward-deployed and product teams: learning from recurring failure patterns, turning tribal knowledge into automated mitigations, and raising the operational floor for the entire company.
EXAMPLE INITIATIVES
You'll work on projects like these as part of the SRE team:
- Improve Baseten SRE Practices, by instrumenting SLOs and SLIs, improving alerting and observability for all services.
- Building AI-assisted tooling for incident triage and response.
RESPONSIBILITIES
- Own the reliability of Baseten's multi-cloud Kubernetes infrastructure, including incident response, post-mortems, and remediation tracking.
- Build and maintain observability infrastructure — metrics, logging, dashboards, and alerting — as code.
- Author, validate, and improve runbooks for recurring failure patterns, ensuring they're structured for low-context, safe execution.
- Identify high-frequency failure patterns and convert them into automated mitigations or self-healing automations.
- Diagnose and resolve runtime issues related to latency, memory behavior, GPU utilization, concurrency, and model lifecycle management.
- Define and instrument SLOs and SLIs across customer workloads and internal services.
- Navigate ambiguity, make principled tradeoffs, and avoid unnecessary complexity in the systems you build and the processes you define.
REQUIREMENTS
- Extensive hands-on experience with Kubernetes (multi-cloud experience across EKS, GKE, or similar is a strong plus).
- Experience in building and maintaining scalable infrastructure.
- Strong foundation in observability tooling: metrics (VictoriaMetrics, Prometheus), logging (Loki, ELK), dashboards (Grafana), and alerting pipelines. Observability-as-code experience is a plus.
- Experience with infrastructure-as-code (Terraform, Helm) and GitOps workflows (Flux CD, ArgoCD).
- Experience writing and improving runbooks, leading incident response, and doing post-mortem analysis.
- Comfort working at the intersection of engineering and operations — you write code, but you also think deeply about process, escalation paths, and operational leverage.
- Familiarity with incident management platforms (incident.io http://incident.io or similar) is a plus.
- No prior ML experience required, but curiosity about how ML models are deployed and served at scale will serve you well.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
Voice is becoming the internet’s next interface, but a production-grade Voice AI system is "hard to build" https://greylock.com/greymatter/voice-agents-easy-to-use-hard-to-build/. You’ll join a small founding team of Baseten Voice AI, focused on bringing state-of-the-art open source models into production for Voice AI customers across productivity, customer service, clinical conversation, creator tools, education, and more. You’ll make a meaningful impact on people’s daily lives and help reshape these industries.
This is a high-impact, high-ownership role. You will be the primary owner of Baseten Voice AI - our in-house inference stack to power Voice AI models - from product roadmap through engineering implementation. You’ll partner closely with Forward Deployed Engineers, Model Performance Engineers, and sister engineering teams to push the boundaries of Voice AI.
EXAMPLE INITIATIVES
- Develop world-class model serving stack for state-of-the-art open-source voice models - reduce end-to-end and tail latency (p95/p99), increase throughput, and improve GPU efficiency via profiling, runtime tuning, and server-level optimizations.
- Build large-scale, real-time infrastructure for multi-model voice agents - orchestrate STT, TTS, and agent components with streaming I/O to meet customer SLOs.
- Design tight training and inference iteration loops for voice model customization - enable fast evaluation, safe rollout, and rapid experimentation for custom voice model development.
- Past projects:
- Baseten leads Coval’s voice AI benchmark https://www.baseten.co/blog/baseten-leads-covals-voice-ai-benchmark/
- How Notion achieved 2-3x lower latency with AI Meeting Notes https://www.baseten.co/resources/customers/how-notion-acheived-2-3x-lower-latency-with-ai-meeting-notes/
- Cost-efficient, high-performance TTS with Qwen3-TTS https://www.baseten.co/blog/cost-efficient-high-performance-qwen3-tts/
- Fine-tuning Qwen3-TTS for high-quality voice cloning https://www.baseten.co/blog/fine-tuning-qwen3-tts-for-high-quality-voice-cloning/
- The fastest Whisper — with streaming and diarization https://www.baseten.co/blog/the-fastest-whisper-transcription-with-streaming-and-diarization/
- NVIDIA Nemotron 3 Diarization: real-time speaker labels at a cent per audio hour https://www.baseten.co/blog/nvidia-nemotron-3-diarization/
RESPONSIBILITIES
- Own and lead Voice AI product areas end-to-end - from architecture and system design through implementation, rollout, and long-term production operations.
- Design, build, and operate real-time, large-scale, high-performance model serving systems for STT, TTS, and voice agent workloads for mission-critical customer deployments
- Drive cross-team collaboration with sister engineering teams to solve full-stack technical problems, align on priorities, and coordinate end-to-end delivery across the product surface area
- Mentor teammates through code reviews, design docs, and technical leadership.
REQUIREMENTS
- Bachelor's degree or higher in Computer Science or related field
- Proven track record owning production-grade real-time, large-scale systems where tail latency (p99) matters.
- Proficient coding abilities in one or more popular programming or scripting languages; Python proficiency is a plus.
- Good taste in product, particularly developer-oriented tools
- Interest in ML/AI infrastructure and willingness to learn
- Strong collaboration and communication skills
- Comfortable using AI coding assistants (e.g., Claude Code, Codex, Cursor) as a daily productivity multiplier — as an AI-native company, we see this as a must-have skill.
NICE TO HAVE
- Experience implementing pipeline-level model runtime optimizations such as dynamic batching, async scheduling, or decode-side throughput improvements.
- Experience building developer platforms: SDKs, CLIs, APIs, and self-serve workflows for ML or infrastructure products.
- Experience with containerization and orchestration technologies (Docker, Kubernetes), service meshes, or distributed scheduling.
- Familiarity with speech/audio ML models (STT, TTS, speech-to-speech)
- Familiarity with model-serving runtimes (vLLM, TensorRT, ONNX).
- Familiarity with systems-level performance profiling across host-device boundaries (e.g. PyTorch Profiler), diagnosing GPU utilization issues
- Exposure to customer-facing engineering: pre-sales prototyping, technical discovery, or working directly with customers to ship solutions.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; New York
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
Product at Baseten is a nascent function. Our company today has a strong engineering culture, is heavily customer-obsessed, and moves fast. We're building the product function now, and you'd be one of the people who defines it. You'll work directly with our founders and with some of the best systems and AI engineers, and you'll set the standard for what product looks like here. PMs at Baseten don't sit above engineers. You earn ownership by being technical, finding the truth in front of customers, building great cross-functional relationships, and shipping great product experiences.
Once a model is deployed, keeping it fast, reliable, and economical at scale is where production inference is won or lost. You'll own the surface that makes that happen: how deployments autoscale, how traffic is routed, how the system fails over, and how workloads scale across clusters and regions. You'll own these as products end to end, both how they work under the hood and how customers configure and observe them, and you'll set the roadmap that infrastructure and product teams alike can build toward. This space is still evolving. Think cloud infrastructure in the mid-2000s. Your job is to make it 10x easier to reliably scale and serve AI models in production, and to set the market standard.
This role is a great fit if you love getting deep in the technical details, and if you'd rather do whatever it takes to ship for customers than stay in the strategy, UX, or docs layer. You're drawn to platforms, systems, GPUs, models, and scaling infrastructure more than to applied AI, and you find real satisfaction in the foundational, sometimes unglamorous work that makes AI systems reliable and scalable at the infrastructure level.
EXAMPLE INITIATIVES
Take a look at these blog posts written by members of our Product and Infrastructure teams:
- How we built Multi-cloud Capacity Management (MCM) https://www.baseten.co/blog/how-we-built-multi-cloud-capacity-management/
- How the Baseten Delivery Network (BDN) makes cold starts fast https://www.baseten.co/blog/how-the-baseten-delivery-network-bdn-makes-cold-starts-fast/
- Baseten brings AI video to life on Nebius https://www.baseten.co/blog/ai-video-nebius-baseten-inference-stack/
RESPONSIBILITIES
- Own how workloads scale and where they land, from autoscaling to demand (up under load, down to zero when idle) to a single placement policy that expresses region, compliance regime, and capacity preference.
- Give compliance-bound workloads right-of-way on sensitive capacity.
- Make production inference reliable by default, so every request reaches a healthy replica and rolling deploys never drop traffic.
- Define region-aware routing, with multi-region and active-active failover as first-class policy, plus health-aware recovery from stuck or bad replicas.
- Build the release engine beneath safe rollouts: the traffic-shifting that powers canary, shadow, and A/B, along with warm-ups, drain, and probes.
- Push the cost and performance frontier for serving AI at scale across latency, throughput, uptime, and cost efficiency.
- Drive a measurable decline in MTTR through self-serve incident management.
- Set the roadmap that infrastructure and product teams build toward, and own each capability end to end, from backend behavior through the customer-facing configuration and observability surface.
REQUIREMENTS
- 8+ years in product management, including deep experience with infrastructure, distributed systems, or ML serving.
- Fluency reasoning about scaling, routing, failover, and the cost/performance frontier, at a level that earns the respect of staff engineers.
- Experience owning capabilities end to end, backend through UX, rather than a single slice.
- Track record driving cross-team roadmaps and the dependencies beneath them.
- Comfort defining a category that doesn't fully exist yet.
NICE TO HAVE
- Hands-on experience with GPU infrastructure.
- Experience with Kubernetes.
- Experience with serving frameworks like vLLM, TensorRT-LLM, or SGLang.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; Remote; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
We are seeking an experienced and proactive Security Engineer to help us build, maintain, and continuously improve the security posture of our rapidly growing ML infrastructure platform. As one of the first dedicated security hires at Baseten, you will work cross-functionally with engineering and operations teams to ensure we’re meeting the highest standards of confidentiality, integrity, and availability. You’ll have an opportunity to shape our security strategy and best practices from the ground up, influencing the way our platform handles sensitive data for both internal and external stakeholders.
RESPONSIBILITIES
- Security architecture and design: Collaborate with engineering teams to design and implement secure systems and infrastructure, including cloud (AWS/GCP) environments and container orchestration platforms.
- Vulnerability management: Lead proactive vulnerability assessments, pen tests, and remediation efforts to ensure our products and infrastructure remain secure.
- Incident response: Develop and maintain incident response processes, including detection, analysis, containment, eradication, and post-incident reviews.
- Identity and access management (IAM): Oversee IAM strategies and tools to ensure the right people have the right level of access to our systems and data.
- Security compliance and audits: Work closely with operations to ensure compliance with relevant standards (e.g., SOC 2, ISO 27001) and assist with audits, policy creation, and risk assessments.
- Employee security training: Develop and deliver security training programs and documentation to keep our team informed about best practices, social engineering threats, and secure coding standards.
- DevSecOps integration: Partner with DevOps teams to embed security into the CI/CD pipeline, automating security checks and fostering a culture of “security as code.”
REQUIREMENTS
- 3+ years of experience in a Security Engineer or similar security-focused role, preferably in a fast-paced startup environment.
- Strong knowledge of cloud security (AWS/GCP), container security, and infrastructure-as-code best practices.
- Hands-on experience with security tooling (SIEM, IDS/IPS, vulnerability scanners) and scripting languages to automate security tasks.
- Familiarity with compliance frameworks such as SOC 2, ISO 27001, and GDPR, and the ability to translate requirements into actionable security controls.
- Incident response expertise, including forensic analysis and root cause investigation.
- Excellent communication skills and the ability to collaborate with cross-functional teams to promote a security-first culture.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
We are looking for an engineer with strong experience in machine learning and solid foundations in math and computer science to join our growing Post-Training team at Baseten.
THE ROLE
Custom models are instrumental to the success of Baseten customers. By inference volume, the overwhelming majority of traffic at Baseten is to and from models that have been post-trained in some way, whether that be through reinforcement learning, supervised finetuning, a recent technique from the literature, or an in-house research technique from Baseten. The Post-Training team is responsible for the success of our customers’ post-trained models, and we employ a wide array of techniques to produce models that are more efficient and higher quality than even the biggest closed source models for the customer’s specific needs.
Your role as a research engineer is to build the in-house tooling to support all of this. We care about training a wide spectrum of different model architectures with a variety of techniques efficiently and at scale. At times this involves zooming deep into a particular technical topic, but more often it involves working across the stack as a whole - systems-level concepts like Kubernetes, cgroups, storage systems, and networking topologies, as well as PyTorch distributed tensor computation, and GPU kernels.
The Manifesto: https://labs.baseten.co/manifesto
RECENT RESEARCH
- Dense, on-policy or both? https://www.baseten.co/research/dense-on-policy-or-both/
- Repeated kv cache for long-running agents https://www.baseten.co/research/repeated-kv-cache-for-long-running-agents/
- Distillation without the dark – replicating black-box on-policy distillation on Baseten https://www.baseten.co/research/distillation-without-the-dark/
We don’t have a rigid set of skills, but here’s some of what we’re looking for:
- A deep understanding of modern ML techniques and tools for training transformers
- Advanced experience in a tensor/array computation library like PyTorch, TensorFlow, Jax, or similar
- A detailed understanding of transformer training parallelism strategies like data parallelism, sharded data parallelism, tensor parallelism, pipeline parallelism, context parallelism
- The experience and knowledge to profile and improve the performance of a distributed GPU program in PyTorch or a similar library
- The ability to perform roofline analysis on a transformer training setup
- A willingness to dive into messy problems, work with researchers, derive specifications by asking important questions, and execute
- Familiarity with HPC and distributed computing platforms like Slurm, Ray, Kubernetes, and Dask
- Familiarity with cluster networking technology like Infiniband, RoCE, GPUDirect
- Solid fundamentals in operating systems concepts like processes, files, kernel drivers, containerization, and networking protocols
- A sense of creativity and willingness to ask difficult questions about our approach, assumptions, and tooling choices
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: New York
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
WHO WE ARE
Enterprise at Baseten means the companies with the most to gain from AI and the most complexity in getting there: large digital natives running products at massive scale, and category leaders in software, financial services, healthcare, and beyond. They have the data, the distribution, and the budget. Most are still deciding what to build, what to run themselves, and what it should cost.
That makes this a consultative sale. You'll spend as much time helping a VP of Engineering pressure-test their AI strategy as you will selling against an alternative, mapping use cases, framing build-vs-buy, and giving clear recommendations grounded in what you've seen work at the frontier. Then you'll do the enterprise work: multithreading across a buying committee, navigating security and procurement, and turning a first workload into an eight-figure relationship.
You'll work alongside our founders, forward-deployed engineers, and GTM leadership, in a seat where the playbook is still being written.
RESPONSIBILITIES
- Own a revenue target end to end, from prospecting and outbounding through closing Tier 1 accounts in your verticals
- Act as a strategic advisor on AI adoption: identify use cases, shape architecture decisions, and lead with clear, opinionated recommendations
- Multithread across large organizations, from the engineers running evals to the executives funding the program to security, legal, and procurement
- Win lighthouse customers that become references for their entire industry
- Partner with forward-deployed engineering on technical evaluations, POCs, and architecture reviews
- Feed signal back to product and engineering. What enterprises need next is a roadmap input we don't get anywhere else
REQUIREMENTS
- 8+ years of enterprise B2B sales experience in technology, ideally infrastructure, API/platform, or developer tooling
- A track record of closing seven- and eight-figure deals by navigating multi-stakeholder buying committees and long, complex cycles
- Demonstrated ability to run a consultative sale. You've helped customers define a strategy, not just evaluate a product
- Strong technical acumen: you can hold your own on model serving, GPU infrastructure, latency, and API architecture
- Experience selling into large digital natives or regulated industries (financial services, healthcare/life sciences, insurance, government)
- Excellent communication and comfort with high autonomy in a fast-moving environment
NICE TO HAVE
- Direct experience selling AI/ML infrastructure, cloud compute, or model deployment platforms
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: New York
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
AI Native is our segment for companies whose core product is AI, from their first model in production through serious scale. You'll be the first person at Baseten to reach many of these founders, and you'll win them early.
This is a high-velocity, high-intensity seat. You're running many early-stage opportunities at once, moving fast with founders who move fast, and going deep enough technically to be useful on day one. If you want a front-row seat to the frontier of AI and the ambition to grow into our largest accounts, this is the seat.
RESPONSIBILITIES
- Source, close, and grow new business with early-stage AI companies. You own pipeline generation, not just what's handed to you
- Run fast, technical sales cycles with founders and early engineering teams, from first call to first production workload
- Prioritize ruthlessly across a high volume of opportunities and drive each one forward without dropping the thread
- Pull in applied research and engineering when a deal needs depth, and keep everyone moving on your timeline
- Bring the field back to product. You see what early AI teams need before the rest of the market does
REQUIREMENTS
- 2+ years of closing sales experience in a SaaS or infrastructure business, with a record of closing
- Genuine curiosity about open-source models and AI infrastructure. You follow model releases and can hold a real conversation with engineers
- Strong prioritization and project management instincts: you know which deal needs you today and you keep the rest alive
- Comfortable selling to founders and technical buyers who expect substance, not a pitch
- Thrives on intensity, ambiguity, and a fast-paced early-stage environment
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; New York
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
We’re hiring a Data Engineer to build and scale Baseten’s internal data platform. This role sits at the intersection of data engineering, analytics, and data science, transforming raw product and business data into reliable datasets that power decision-making.
You’ll design the data models, pipelines, and analytics infrastructure that enable teams across Product, Engineering, Finance, Marketing, and Sales to understand usage and performance. This includes working with AI inference, infrastructure, and observability data to generate insights about the product, business operations and platform economics.
You’ll partner closely with stakeholders to build robust, scalable pipelines, define company-wide metrics that inform strategy and planning.
RESPONSIBILITIES
- Design and maintain core data models and semantic layers
- Develop and orchestrate batch and streaming data pipelines using technologies such as Apache Beam, Kafka, Airflow, or similar frameworks
- Analyze inference and infrastructure telemetry, including data from OpenTelemetry, Grafana, and other observability tools
- Define and maintain company-wide metrics across product usage, performance, and customer lifecycle
- Enable self-service analytics through agents and tools, with well-structured semantic layers and context
- Ensure data reliability and quality through testing, documentation, and governance
PREFERRED QUALIFICATIONS
- Understanding of inference metrics such as latency, throughput, token usage, and model performance
- Experience supporting B2B SaaS and/or consumption-based platforms
- Application of forecasting and predictive modeling (e.g., ARIMA, Prophet) to business processes
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
This role sits at the frontier of our research agenda. You will pursue open problems at the intersection of post-training methodology and performant inference, and then collaborate with research engineering to translate findings into production systems.
A meaningful portion of your time will be dedicated to research that deepens our understanding of how models learn, alignment, and architectural efficiency — questions that may not have immediate product application. The remainder will be directed toward research that solves concrete problems for Baseten's platform and customers, who are the fastest growing AI companies in the world like Cursor, Lovable, and Notion.
We are looking for someone with sharp research taste and genuine creative instinct for problem selection. Someone who can identify questions that matter, design clean experiments to answer them, and push the state of the art. The environment here is not theoretical, but rather research that can be validated with eager customers who are serving billions of tokens a second.
The Manifesto: https://labs.baseten.co/manifesto
RECENT RESEARCH
- Towards infinite context windows: neural KV cache compaction https://www.baseten.co/research/towards-infinite-context-windows-neural-kv-cache-compaction/
- Dense, on-policy or both? https://www.baseten.co/research/dense-on-policy-or-both/
- Repeated kv cache for long-running agents https://www.baseten.co/research/repeated-kv-cache-for-long-running-agents/
- Distillation without the dark – replicating black-box on-policy distillation on Baseten https://www.baseten.co/research/distillation-without-the-dark/
RESPONSIBILITIES
- Define and pursue a research agenda spanning both foundational and applied work, with the applied component connected to Baseten's platform and customer needs.
- Design and execute rigorous experiments, frequently at meaningful scale (multi-node, trillion parameter models).
- Work with customers to translate domain-specific requirements into research problems, where relevant to your agenda.
- Publish at top venues (NeurIPS, ICML, ICLR) and establish Baseten's research presence.
- Collaborate with model performance and training infrastructure teams to bridge research findings and inference production systems.
- Mentor junior researchers and shape the technical direction of the research organization as it grows.
PREFERRED QUALIFICATIONS
- Master’s or PhD research depth in machine learning, with first-author publications at top venues
- Demonstrated ability to move from theory through implementation to empirical results — not exclusively theoretical or exclusively engineering work
- Judgment about problem selection, the ability to distinguish research that advances a metric from research that changes how systems are built
- Willingness to operate in a startup environment where the majority of research informs product decisions, with timelines measured in months rather than years
- Background spanning multiple research areas (e.g., both interpretability and RL, or both systems and training methodology)
- Track record of open-source contributions or community building in ML research
OUR VIEW ON TALENT
Many of the labs that exist today run a credentialist talent model. Concentrate the most already-legible researchers, and assume the concentration compounds. The best researchers in this field are very often not yet legible. Research engineers who have spent years inside a production stack and developed insights no PhD program teaches; PhDs working on the wrong-shaped problem at the right-shaped lab; operators who have been close to real systems long enough to see things credentialed researchers have never had to see. If you don’t have the traditional qualifications and are doing exceptional work, we’d love to chat.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
As a Software Engineer at Baseten, you will own one of the most critical surfaces of our business: pricing, billing, and revenue infrastructure.
As we launch more and more products— billing is no longer just operational plumbing. It is a strategic lever for growth. This role will establish clear ownership of billing as a function and create leverage for Finance, Sales, and GTM teams while maintaining a seamless customer experience.
RESPONSIBILITIES
- Own Baseten’s end-to-end billing and revenue infrastructure, including pricing, invoicing, metering, and reporting foundations.
- Build and evolve our billing platform and integrations (including Orb), ensuring correctness, auditability, and a high-trust experience for customers and internal teams.
- Partner closely with Finance, Sales, GTM, and Forward Deployed Engineering to turn real-world workflows into reliable internal tooling and automation (quoting, approvals, renewals, usage reconciliation, revenue reporting).
- Design systems that scale with new products, packaging, and go-to-market motions, making billing a strategic lever for growth.
- Drive reliability and operational excellence for revenue-critical workflows: monitoring, alerting, incident response, backfills, and clear runbooks.
- Lead from the front on high-impact projects: clarify requirements, propose crisp technical approaches, ship iteratively, and raise the bar on quality and velocity.
- Debug and resolve production issues with urgency, communicating clearly with stakeholders and closing the loop with durable fixes.
REQUIREMENTS
- Bachelor's degree or higher in Computer Science or related field
- Experience with billing systems or building internal tools
- Deep knowledge of the web stack & databases
- Strong collaboration and communication skills
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; New York
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
As a Solutions Architect at Baseten you will partner closely with Sales and customers to translate business needs into technical solutions, run technical discovery, and guide repeatable deployments and proofs of value for customers. This role is a great fit for entrepreneurial, customer-facing technical professionals who want a front-row view into how modern companies adopt AI at scale, and who enjoy working across technical discovery, solution design, demos, deployment scoping, and hands-on customer implementations, in close partnership with Sales and Engineering.
RESPONSIBILITIES
- Partner with Sales on customer discovery calls (most often second calls, occasionally first calls for large accounts).
- Lead demos and technical scoping to align on success criteria, architecture, and deployment approach.
- Own benchmarking and repeatable deployments, including:
- Handling standard deployment patterns and configurations across many modalities – LLMs, embeddings, image and video generation, Voice AI, etc.
- Advising on tradeoffs like H100s vs B200s and latency-optimized vs throughput-optimized setups.
- Driving consistent “playbook” style deployments for common models and use cases.
- Become a power user of different runtimes such as vLLM, SGLang, and TRT-LLM and all the common configurations and tradeoffs between them
- Drive POC and project execution, including:
- Scoping POCs and keeping stakeholders aligned on timeline, deliverables, and next steps.
- Acting as the “ringleader” or project manager for POCs.
- Pulling in Forward Deployed Engineering (FDE) support when deeper or more complex technical work is needed.
REQUIREMENTS
- AI/ML background and the ability to credibly discuss AI/ML topics with technical stakeholders.
- Strong customer-facing communication skills, including the ability to run structured discovery and clarify ambiguous requirements.
- Technical depth to scope solutions, without needing to write production code.
- Ability to script and prototype as needed, including comfort “vibe coding” to move quickly in technical workflows.
NICE TO HAVE
- Experience running or supporting benchmarks for ML inference deployments.
- Familiarity with infrastructure tradeoffs relevant to inference performance and cost (for example GPU selection and latency versus throughput tuning).
- Experience serving as a cross-functional technical lead for customer POCs, including coordination across Sales and Engineering.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
At Baseten, we are building the global operating system for distributed, heterogeneous AI hardware. We believe that as LLM and multi-modal workloads scale, the network is the computer. We are looking for foundational engineers to lead our GPU Networking efforts, making RDMA a first-class building block in our infrastructure and unlocking the next generation of distributed inference optimizations.
Networking and compute are no longer separate disciplines; they are converging. The massive throughput of H100, B200, and NVL72 architectures enables and demands a new approach where communication is co-optimized alongside computation. We are entering an era where the network is an active accelerator, leveraging smart hardware offloads and direct interconnects to ensure that data movement operates at wire-speed.
In this role, you will go beyond network configuration to architect the software fabric that unifies thousands of GPUs into a cohesive operating system. While you will leverage the best of the open-source ecosystem, you won't be limited by it. Where off-the-shelf solutions stop, you will build from scratch, engineering the primitives required to co-optimize communication and compute for Disaggregated Serving, Wide Expert Parallelism (WideEP), and lightening cold starts.
RESPONSIBILITIES
- Make RDMA First-Class: You will work on integrating RDMA/RoCE/InfiniBand capabilities directly into our inference stack, helping us move beyond TCP/IP to unlock order-of-magnitude improvements in bandwidth and latency.
- Optimize Distributed Inference: You will implement and tune the networking layers necessary for efficient Disaggregated KV Cache Offload and WideEP, ensuring seamless communication across NVLink and InfiniBand for our MoE models.
- Enable Serverless-Grade Startup Speeds for LLMs: You will work deeply with checkpointing and storage mechanisms to enable sub-10-second startup for trillion-parameter models.
- Deep-Dive into Hardware: You will characterize and validate networking performance on bleeding-edge clusters (H100/H200, B200/B300, GB200/300 NVL72), writing the acceptance tests that ensure our hardware delivers peak achievable throughput and minimal latency.
- Build Observability: You will design the tools that let us visualize packet flow, congestion, and effective bandwidth across the GPU interconnects, helping us diagnose complex distributed system behaviors.
- Optimize Kernels: You will work with communication libraries (NCCL, NVSHMEM) and potentially write custom communication kernels to overlap compute and data transfer.
REQUIREMENTS
- You have deep experience with high-performance networking protocols (InfiniBand, RoCE v2) and understand the physics of data movement.
- You are fluent in C++ or Python, with the ability to bridge the gap between high-level logic and hardware. You have a deep understanding of the memory hierarchy in modern NVIDIA architectures (H100/Blackwell) and know how to optimize for it.
- You like going deep. You aren't afraid to dive into TensorRT-LLM source code, write custom C++ / Python bindings, or debug NVLink topology issues.
- You know when to use an off-the-shelf solution and when we need to build a custom solution because the upstream tools (like standard Kubernetes networking) are too slow for our needs.
NICE TO HAVE
- Deep knowledge of NCCL, NVSHMEM, and UCX.
- Experience with Rust for systems-level or performance-critical networking code is a strong plus
- Experience with GPUDirect Storage (GDS) or high-performance filesystems like Weka or 3FS.
- Familiarity with TensorRT-LLM, vLLM, or SGLang.
- Experience running low-level benchmarks to "qualify" new hardware clusters.
THE TEAM
- Bleeding Edge Hardware: We are preparing to bring Blackwell (B200/B300) and then Rubin architectures online. You will be one of the first engineers in the industry optimizing networking for NVL72/GB300 racks.
- We go deep: We operate at every depth. Whether it’s tuning hardware interconnects, writing custom communication kernels, or designing distributed inference strategies, we work across the entire stack to deliver performance that goes far and beyond.
- High Impact: The networking optimizations you build will directly enable features that no one else in the industry has fully mastered yet, like seamless multi-node WideEP and instant model hydration.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
We are seeking a Sales Manager to help lead a team of Strategic Account Executives. This person will be responsible for building and coaching a team of high-performing sales reps, driving revenue growth, and partnering closely with product and engineering to bring our cutting-edge AI infrastructure to customers.
RESPONSIBILITIES
- Lead and mentor a team of Strategic Account Executives to consistently exceed pipeline and revenue goals.
- Help define and execution on go-to-market strategy for our fastest growing customer segment.
- Collaborate cross-functionally with Marketing, Product, and Engineering to align customer needs with Baseten’s product roadmap.
- Be deeply engaged with the product, enabling reps to have highly technical conversations with prospects and customers.
- Foster a culture of accountability, learning, and collaboration within the sales team.
REQUIREMENTS
- 6+ years of closing sales experience, with 2+ years in management leading high-performing teams.
- Strong technical acumen, ideally with background in AI infrastructure, cloud infrastructure, or developer platforms.
- Comfortable operating in the weeds with technical products and guiding reps through complex deals.
- Proven track record of success in Strategic/Enterprise sales environments.
- Based in San Francisco or New York and open to coming in office at least 3 days per week (Tuesday-Thursday).
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; New York
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
We’re looking for a customer-obsessed software engineer to come ship with us. You’ll own features like multi-node training and products like serverless reinforcement learning (RL) from conception to MVP (and from MVP to GA!). You’ll work through the stack, architecting solutions from API and UI down to our infrastructure layer. You’ll fine tune models yourself to develop an understanding of user workflows. You’ll work closely with research engineers leveraging state-of-the-art training techniques to build experiences that accelerate model development and solve for real pain points. If you’re excited to dive deep into the training, let’s talk!
THE PRODUCT
Take a look at what we’ve built so far:
- Overview of the product so far https://www.baseten.co/blog/baseten-training-is-ga/#training-is-now-ga
- Training docs overview https://docs.baseten.co/training/overview
- Story of the Training product https://www.baseten.co/blog/a-q-a-from-inference-to-training-the-inside-story-of-baseten-s-newest-product/
- Research we've done https://www.baseten.co/resources/research/
EXAMPLE INITIATIVES
- Checkpointing Pipeline: Our checkpointing pipeline starts with automated checkpointing, a feature that ensures that versions of models created during training are automatically backed up to the cloud. Users are able to then deploy checkpoints seamlessly into inference servers, providing point-and-click integrations into inference frameworks like vLLM and Baseten’s Inference Stack. This enables customers to quickly evaluate the performance of their checkpoints with real traffic.
- Multinode training: Multinode training enables customers to easily run training jobs across multiple compute nodes, enabling users to train large models like GLM 4.7 and DeepSeek. We’ve built deeply at the Kubernetes layer to ensure that scheduling, startup, inter-node communication, and shutdown happen seamlessly under the hood and as the user expects.
- Training DX: Customers come to train on Baseten because it helps them get to value fast. To do this, we ensure that the features we ship aren’t just fast, but are easy to iterate with. We enhanced Baseten’s metrics from pod-level GPU summaries to per-GPU and per-Node. We’ve built a CLI experience that caters to terminal users, and UI experiences that enable user to seamlessly manage their training jobs.
RESPONSIBILITIES
- Iterate like crazy
- Design ergonomic APIs and abstractions to model complex resources and lifecycles
- Work throughout the stack (API layer, backend and database implementation, infra layer; frontend is a plus) to implement features.
- Fine-tune and deploy models to develop intuition around training workflows.
- Partner closely with model developers and world-class research engineers to understand the requirements and pain points of post-training workflows.
- Drive long-term improvements to improve reliability of systems and velocity of development
- Fix bugs & resolve customer issues with urgency
REQUIREMENTS
- 5+ years experience building software applications
- Deep knowledge of the web stack, databases, and distributed systems
- Experience developing developer tooling or infrastructure products for external or internal users.
- Good taste in product, particularly developer-oriented tools
- Interest in ML/AI infrastructure and willingness to learn
- Driven by high agency and ownership
- Strong communication skills with the ability to bridge technical depth and business needs
NICE TO HAVE
- Experience launching features and products through different release cycles (MVP, Beta, GA, etc.)
- Experience with model development methods and paradigms, like Supervised Fine-Tuning, Reinforcement Learning, Synthetic Data Generation, LoRA, Full Finetunes, etc.
- Familiarity or experience with the open source training stack and frameworks (NCCL, PyTorch, Megatron, NemoRL, VeRL, Axolotl, HF Trainer) and distributed training techniques (FSDP, DeepSpeed).
- Experience developing AI products, tooling, or agents
- Frontend fluency
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
ГибридSan Francisco
165 000 – 330 000 $
ГибридSan Francisco
165 000 – 330 000 $
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.