Location: San Francisco; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
We are looking for Software Engineers to join our team. This is a specialized, high-impact role sitting at the intersection of high-performance computing (HPC) and Large Language Model (LLM) engineering. You will not just be building the automated "speedometer and diagnostic" suite for our next-generation AI infrastructure; you will be defining the roadmap, driving key technical decisions, and taking full ownership of the future of this work.
RESPONSIBILITIES
- Benchmarking: Evaluate, run and automate standard LLM quality benchmarks (GSM8K, MMLU) alongside custom performance suites for specific workloads (e.g., long-context window, KV cache reuse, disaggregated serving).
- DevEx Improvement: Develop and maintain internal GPU-enabled development environments (similar to GitHub Codespaces). You will ensure the team has seamless, high-performance "dev machines" optimized for model experimentation.
- Tool Development: Build and contribute to open-source tools such as InferenceMAX and genai-bench to automate model evaluation, benchmarking and analysis.
- System Profiling: Use profilers like PyTorch Profiler, NVIDIA Nsight Systems and py-spy to collect performance profiles, identify bottlenecks, and debug the compute/networking stack.
- Monitoring & Observability: Develop real-time dashboards and alerts to monitor system health, model startup times, and runtime performance.
- Continuous Integration: Automate performance testing via CI/CD pipelines to catch regressions and build release workflow automation for the model runtimes stack.
- Optimization Automation: Build tools to find the "Pareto frontier"—identifying the absolute best configuration (latency vs. cost vs. quality) for a given model and workload.
REQUIREMENTS
This is a mid-senior, high leverage role. We care about your technical depth, strong communication skills to drive cross-team efforts, ability to navigate vague requirements and mentor other engineers. We want to talk to you if you have:
- A Love for Systems & Hardware: You aren’t just interested in the AI; you want to understand GPU memory subsystems, InfiniBand, and how data moves across a cluster.
- An Automation Mindset: You believe that if a task has to be done twice, it should be scripted. You have a passion for stress-testing and fuzzy testing to find the "breaking point" of a system.
- Mathematical Curiosity: A desire to understand the underlying math of Transformers and how it translates into FLOPs and memory requirements.
- Technical Toolkit: Familiarity with Python, and an eagerness to master the NVIDIA software stack. C++ familiarity is good to have.
WHY THIS ROLE
- Direct Impact: Your tools will be the gatekeeper for what defines "good" performance for our customers.
- Deep Learning (Literally): You will gain world-class expertise in GPU orchestration and LLM inference that few engineers in the industry possess.
- High Ownership: As the lead of a small team, you will have the autonomy to build tools from scratch and contribute to open-source projects.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
ГибридSan Francisco; Toronto; New York; Montreal; Seattle
Location: San Francisco
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
We are seeking a Sales Manager to help lead a team of Account Executives within our AI Native segment. This hire will be responsible for building and coaching a team of high-performing sales reps, driving revenue growth, and partnering closely with product and engineering to bring our cutting-edge AI infrastructure to customers.
RESPONSIBILITIES
- Lead and mentor a team of AI Native Account Executives to consistently exceed pipeline and revenue goals.
- Help define and execution on go-to-market strategy for our fastest growing customer segment.
- Hire and scale the team by recruiting, interviewing, and onboarding top talent
- Collaborate cross-functionally with Marketing, Product, and Engineering to align customer needs with Baseten’s product roadmap.
- Be deeply engaged with the product, enabling reps to have highly technical conversations with prospects and customers.
- Foster a culture of accountability, learning, and collaboration within the sales team.
REQUIREMENTS
- 4+ years of closing sales experience, with 2+ years in management leading high-performing teams.
- Strong technical acumen, ideally with background in AI infrastructure, cloud infrastructure, or developer platforms.
- Comfortable operating in the weeds with technical products and guiding reps through complex deals.
- Proven track record of success in high velocity sales environments.
- Based in San Francisco or New York City and open to coming in office at least 3 days per week (Tuesday-Thursday).
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; Remote; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
As a Cloud Platform Engineer, you'll envision and build robust systems and processes that ensure our infrastructure is scalable, reliable, and efficient. This can range from automating deployments and monitoring systems to optimizing performance and managing incidents.
We all work closely with our users, learning from their past struggles in operationalizing ML, onboarding them onto our platform, and turning our learnings into ideas for improving Baseten.
EXAMPLE INITIATIVES
You'll get to work on these types of projects as part of our Infrastructure team:
- Multi-cloud capacity management https://www.baseten.co/blog/how-baseten-multi-cloud-capacity-management-mcm-powers-cloud-self-hosted-and-hybr/
- Inference on B200 GPUs https://www.baseten.co/blog/accelerating-inference-nvidia-b200-gpus/
- Multi-node inference https://www.baseten.co/blog/how-multi-node-inference-works-llms-deepseek-r1/
- Fractional H100 GPUs for efficient model serving https://www.baseten.co/blog/using-fractional-h100-gpus-for-efficient-model-serving/
RESPONSIBILITIES
- Build and maintain scalable infrastructure to support the deployment and operation of machine learning models.
- Establish standards and best practices for reliability and performance across the infrastructure.
- Automate processes when relevant, particularly for managing CI/CD pipelines.
- Own products and projects end-to-end, functioning as both an engineer and a project manager, with a focus on user empathy, project specification, and end-to-end execution.
- Collaborate with cross-functional teams to understand project requirements and translate them into technical solutions.
- Mentor junior team members and contribute to knowledge sharing within the organization.
- Navigate ambiguity and exercise good judgment on tradeoffs and tools needed to solve problems, avoiding unnecessary complexity.
- Demonstrate pride, ownership, and accountability for your work, expecting the same from your teammates.
REQUIREMENTS
- Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field.
- Extensive experience with Kubernetes.
- Experience in building and maintaining scalable infrastructure.
- Experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation, Pulumi) and CI/CD tooling (e.g., GitHub Actions, GitLab CI, Circle CI, Jenkins).
- Relevant OSS observability experience (Prometheus, ELK stack, Grafana stack, OpenTelemetry) is a plus.
- Ability to own projects end-to-end, from project specification to execution.
- No prior machine learning experience required, but should be open to learning about it.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: New York
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
Strategic accounts at Baseten are the largest and fastest-growing AI companies in the world. These are the teams defining the future of what AI products and services look like. These accounts can scale rapidly from one token to billions of tokens in a matter of weeks. This role owns these relationships, working directly with founders and engineering leaders on mission-critical and large-scale-AI problems in production—and shaping what we build next.
This is a highly technical sale. You’ll trade opinions on the latest open-source model releases, run fast and nuanced evaluations alongside customer engineering teams, and often pulling in SMEs from applied research to infrastructure engineers to win. You’ll bring tight sales fundamentals and process discipline, while maintaining flexibility and creativity in how you run each cycle.
This role is pioneering what sales looks like at the bleeding-edge of technology sales. This is a front row seat to the most consequential decisions made at the forefront of Artificial Intelligence. There is no faster place to learn and make an immediate impact.
RESPONSIBILITIES
- Own a focused portfolio of high-growth, strategic AI-native accounts end to end — from technical evaluation and initial workload landing through expansion as inference usage scales.
- Lead technical evaluations and complex, multi-stakeholder sales cycles from first conversation through close. Bring strong sales fundamentals and process discipline, while staying flexible and creative in how you run each sales cycle.
- Build trusted relationships with founders and technical leaders, becoming a credible partner on model, infrastructure, and inference decisions.
- Orchestrate stakeholders across applied research, engineering, and leadership to win technical evaluations and solve customer problems.
- Bring customer signal back to product, shaping roadmap priorities through the needs and patterns you see in the field.
- Stay close after close: help customers expand from an initial workload into additional use cases across the organization.
REQUIREMENTS
- 5+ years of sales experience in infrastructure, developer tools, data, or another consumption business, with a record of closing complex technical deals.
- Proven net-new experience selling complex technical products in fast-moving environments.
- Strong sales fundamentals across discovery, multi-threading, champion-building, and deal momentum.
- Genuine curiosity for open-source models and the AI infrastructure landscape. You follow model releases and can hold your own with engineers.
- Highly dynamic: comfortable when a deal goes off-script, able to meet customers where they are, and willing to change your approach without losing rigor.
- Strong technical project management: you can run a thorough evaluation across multiple workstreams and create clarity and direction for Baseten to win..
- Proven ability to sell internally, earning engineering time, aligning leadership, and getting cross-functional teams to move
- Scrappy, low-ego, collaborative operator. You run toward ambiguous problems, create structure where none exists, and earn internal support without relying on rigid swim lanes.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; New York
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
As a Software Engineer on the Training Infrastructure team, you'll architect and lead development of our training platform, supporting top tier research engineers and model developers. You'll make key technical decisions for the infrastructure enabling developers to deploy, scale, and monitor their workloads with high performance and reliability. You’ll own scheduling, storage, networking, reliability, and observability of technical systems in the training stack
EXAMPLE INITIATIVES
Take a look at what we’ve built so far:
- Overview of the product so far https://www.baseten.co/blog/baseten-training-is-ga/#training-is-now-ga
- Training docs overview https://docs.baseten.co/training/overview
- Story of the Training product https://www.baseten.co/blog/a-q-a-from-inference-to-training-the-inside-story-of-baseten-s-newest-product/
- Research we've done https://www.baseten.co/resources/research/
RESPONSIBILITIES
- Design and architect scalable infrastructure systems for our ML training platform (e.g. scheduling, storage, and networking)
- Partner closely with developers and research engineers to translate complex training requirements into technical solutions
- Design and architect a global training scheduler
- Design and architect reinforcement learning systems and continuous learning pipelines
- Drive long-term improvements to increase reliability of systems and velocity of development
- Partner closely with SRE and Capacity teams to unlock state of the art training infrastructure
- Make critical architectural decisions balancing performance with system reliability
- Lead technical discussions and mentor junior engineers on infrastructure best practices
- Contribute to long-term technical strategy and infrastructure roadmap
REQUIREMENTS
- Bachelor’s degree or higher in Computer Science or related field
- 5+ years of experience
- Proficiency in Go, with
- Deep expertise with Kubernetes in production environments
- Advanced understanding of distributed systems concepts and performance tuning
- Proven experience designing observability systems
- Experience with ML/AI workloads and MLOps platforms
NICE TO HAVE
- Experience with distributed storage systems
- Python experience a plus
- Extensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius)
- Experience with workload orchestration platforms like Temporal or Airflow
- Familiarity or experience with the open source training stack and frameworks (NCCL, PyTorch, Megatron, NemoRL, VeRL, Axolotl, HF Trainer) and distributed training techniques (FSDP, DeepSpeed).
- Experience developing AI products, tooling, or agents
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
AI Native is our segment for companies whose core product is AI, from their first model in production through serious scale. You'll be the first person at Baseten to reach many of these founders, and you'll win them early.
This is a high-velocity, high-intensity seat. You're running many early-stage opportunities at once, moving fast with founders who move fast, and going deep enough technically to be useful on day one. If you want a front-row seat to the frontier of AI and the ambition to grow into our largest accounts, this is the seat.
RESPONSIBILITIES
- Source, close, and grow new business with early-stage AI companies. You own pipeline generation, not just what's handed to you
- Run fast, technical sales cycles with founders and early engineering teams, from first call to first production workload
- Prioritize ruthlessly across a high volume of opportunities and drive each one forward without dropping the thread
- Pull in applied research and engineering when a deal needs depth, and keep everyone moving on your timeline
- Bring the field back to product. You see what early AI teams need before the rest of the market does
REQUIREMENTS
- 2+ years of closing sales experience in a SaaS or infrastructure business, with a record of closing
- Genuine curiosity about open-source models and AI infrastructure. You follow model releases and can hold a real conversation with engineers
- Strong prioritization and project management instincts: you know which deal needs you today and you keep the rest alive
- Comfortable selling to founders and technical buyers who expect substance, not a pitch
- Thrives on intensity, ambiguity, and a fast-paced early-stage environment
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
The largest, most demanding enterprises are starting to run on Baseten, and they arrive with a range of security, compliance, and procurement requirements. As an Engineer on Baseten's enterprise engineering team, you'll build the capabilities that enable large organizations like Writer, HubSpot, and Notion to succeed on Baseten. Enterprise engineering authors the core building blocks, APIs, and user experiences powering the Baseten platform: identity and access management, billing, regional isolation, and self-hosted and single-tenant deployment options.
This is deep product and systems work across the full stack, from designing authentication and authorization systems using standards like OAuth and OIDC to shipping the admin experiences enterprise IT teams use to manage their organization.
EXAMPLE INITIATIVES
Recent and upcoming work on the team:
- Fine-grained authorization for users, service accounts, and agentic workloads
- SSO and SCIM support, allowing customers to centralize and automate access to Baseten
- Expanding the billing platform to support evolving pricing models, advanced data exports, and controls to manage spend
- In-product management and enforcement of customer compliance requirements like data residency and HIPAA
- Securing network paths in and out of a customer's models with private connectivity and ingress and egress restrictions
- Allowing customers to run Baseten inside their own VPC, on-prem, or a dedicated single-tenant environment
RESPONSIBILITIES
- Lead complex, ambiguous engineering initiatives from problem definition and technical design through implementation, launch, and iteration.
- Make thoughtful architectural decisions, balancing near-term customer needs with long-term simplicity, scalability, and maintainability.
- Partner with product, design, and customer-facing teams to translate user feedback and requests into product requirements and durable technical solutions.
- Establish strong engineering practices for quality, security, observability, and operational ownership.
- Provide technical leadership and mentorship, helping teammates grow while raising the quality of design and execution across the team.
REQUIREMENTS
- Experience building enterprise software, including work on one or more of: identity and access management, billing systems, multi-tenant isolation controls, private connectivity, or compliance program initiatives.
- Demonstrated ability to lead technical projects, develop and operate systems running at scale, and collaborate with customers to understand their needs.
- Comfort working across the full stack, from product and application code to cloud and Kubernetes infrastructure.
- Preferred: Experience building AI or data-intensive infrastructure products.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
We’re seeking a GPU Kernel Engineer to join our team at the cutting edge of AI acceleration, where your code directly impacts the performance of state-of-the-art machine learning models. As a GPU Kernel Engineer, you'll craft the foundation that powers modern AI workloads, optimizing every microsecond of computation to enable breakthrough applications.
You'll work in a fast-paced, intellectually stimulating environment where technical excellence is paramount and your contributions directly influence production systems serving millions of users across numerous products. This role offers exceptional growth potential for engineers passionate about low-level optimization and high-impact systems work.
EXAMPLE INITIATIVES
You'll get to work on these types of projects as part of our Model Performance team:
- Baseten Embeddings Inference: The fastest embeddings solution available https://www.baseten.co/blog/introducing-baseten-embeddings-inference-bei/
- The Baseten Inference Stack https://www.baseten.co/resources/guide/the-baseten-inference-stack/
- Driving model performance optimization https://www.baseten.co/blog/driving-model-performance-optimization-2024-highlights/
RESPONSIBILITIES
Core Engineering Responsibilities
- Design and implement high-performance GPU kernels for key ML operations, including matrix multiplications, attention mechanisms, and mixture-of-experts routing
- Write and optimize code using CUDA, PTX assembly, and architecture-specific techniques
- Apply advanced performance optimization methods such as memory coalescing, warp-level programming, tensor core acceleration, and compute/memory overlap
Performance & Innovation
- Implement cutting-edge features like quantization (FP8/FP4), sparsity, and compute/communication overlap
- Identify and resolve performance bottlenecks using tools like Nsight Systems, Nsight Compute, and Torch Profiler
- Collaborate with research teams to productionize theoretical advancements
Impact & Collaboration
- Contribute to internal and open-source GPU libraries
- Present technical contributions at industry conferences (e.g., NVIDIA GTC, AWS re:Invent)
REQUIREMENTS
- Strong understanding of GPU architecture and programming paradigms:
- Memory hierarchy (global, shared, registers, L1/L2 cache)
- Thread/block/grid organization
- Synchronization techniques and race condition mitigation
- Proficient in C++ and GPU performance profiling tools
- Knowledge of:
- CUDA C++ API
- Memory access patterns and bandwidth optimization
- Numerical precision and quantization strategies
- Modern GPU features (e.g., tensor cores, async operations)
NICE TO HAVE
- Experience with Transformer models and attention optimization (e.g., Flash Attention)
- Familiarity with GPU kernel libraries: Cutlass, Triton, Thrust, CUB
- Background in GEMM tuning and distributed/multi-GPU compute
- Contributions to open-source GPU projects
- Research publications or conference presentations on GPU performance
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
Strategic accounts at Baseten are the largest and fastest-growing AI companies in the world. These are the teams defining the future of what AI products and services look like. These accounts can scale rapidly from one token to billions of tokens in a matter of weeks. This role owns these relationships, working directly with founders and engineering leaders on mission-critical and large-scale-AI problems in production—and shaping what we build next.
This is a highly technical sale. You’ll trade opinions on the latest open-source model releases, run fast and nuanced evaluations alongside customer engineering teams, and often pulling in SMEs from applied research to infrastructure engineers to win. You’ll bring tight sales fundamentals and process discipline, while maintaining flexibility and creativity in how you run each cycle.
This role is pioneering what sales looks like at the bleeding-edge of technology sales. This is a front row seat to the most consequential decisions made at the forefront of Artificial Intelligence. There is no faster place to learn and make an immediate impact.
RESPONSIBILITIES
- Own a focused portfolio of high-growth, strategic AI-native accounts end to end — from technical evaluation and initial workload landing through expansion as inference usage scales.
- Lead technical evaluations and complex, multi-stakeholder sales cycles from first conversation through close. Bring strong sales fundamentals and process discipline, while staying flexible and creative in how you run each sales cycle.
- Build trusted relationships with founders and technical leaders, becoming a credible partner on model, infrastructure, and inference decisions.
- Orchestrate stakeholders across applied research, engineering, and leadership to win technical evaluations and solve customer problems.
- Bring customer signal back to product, shaping roadmap priorities through the needs and patterns you see in the field.
- Stay close after close: help customers expand from an initial workload into additional use cases across the organization.
REQUIREMENTS
- 5+ years of sales experience in infrastructure, developer tools, data, or another consumption business, with a record of closing complex technical deals.
- Proven net-new experience selling complex technical products in fast-moving environments.
- Strong sales fundamentals across discovery, multi-threading, champion-building, and deal momentum.
- Genuine curiosity for open-source models and the AI infrastructure landscape. You follow model releases and can hold your own with engineers.
- Highly dynamic: comfortable when a deal goes off-script, able to meet customers where they are, and willing to change your approach without losing rigor.
- Strong technical project management: you can run a thorough evaluation across multiple workstreams and create clarity and direction for Baseten to win.
- Proven ability to sell internally, earning engineering time, aligning leadership, and getting cross-functional teams to move
- Scrappy, low-ego, collaborative operator. You run toward ambiguous problems, create structure where none exists, and earn internal support without relying on rigid swim lanes.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; Remote; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
As an Infrastructure Software Engineer at Baseten, you'll build and maintain components of our ML inference platform that powers production AI applications. You'll contribute to the core infrastructure, enabling developers to deploy, scale, and monitor ML models with high performance.
EXAMPLE INITIATIVES
You'll get to work on these types of projects as part of our Infrastructure team:
- Multi-cloud capacity management https://www.baseten.co/blog/how-baseten-multi-cloud-capacity-management-mcm-powers-cloud-self-hosted-and-hybr/
- Inference on B200 GPUs https://www.baseten.co/blog/accelerating-inference-nvidia-b200-gpus/
- Multi-node inference https://www.baseten.co/blog/how-multi-node-inference-works-llms-deepseek-r1/
- Fractional H100 GPUs for efficient model serving https://www.baseten.co/blog/using-fractional-h100-gpus-for-efficient-model-serving/
RESPONSIBILITIES
- Develop infrastructure components for our ML inference platform using Python and Go
- Implement and maintain Kubernetes deployments for model serving
- Contribute to our inference orchestration layer for model deployments
- Build and enhance monitoring systems for model performance metrics
- Implement efficient resource management solutions for ML workloads
- Support infrastructure automation to improve ML deployment workflows
- Work closely with team members to implement technical solutions
- Help balance performance optimization with system reliability
- Participate in technical discussions around infrastructure improvements
- Learn and apply infrastructure best practices
REQUIREMENTS
- Bachelor's degree or higher in Computer Science or related field
- Proficient coding abilities in one or more popular programming or scripting languages; Go proficiency is a plus
- Working knowledge of Kubernetes and containerization
- Basic understanding of machine learning concepts and model serving
- Familiarity with distributed systems concepts
- Experience with basic monitoring and logging tools
- Interest in ML/AI infrastructure and willingness to learn
- Strong collaboration and communication skills
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; New York
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
As an Outbound Sales Development Representative at Baseten, you'll drive strategic outbound into a defined set of target accounts - partnering closely with your Account Executive to research key decision-makers and break through via cold calls, email, and LinkedIn. Together, you'll turn cold accounts into qualified pipeline.
RESPONSIBILITIES
- Build revenue pipeline by setting introductory meetings with potential businesses and key decision makers.
- Help influence Baseten's product roadmap for customers and prospects.
- Identify high-potential businesses and verticals and develop and execute outbound strategies to bring them to Baseten.
- Stay up-to-date on market trends, competition, and industry developments.
- Manage and document the progression of the sales pipeline.
- Drive pre- & post-engagement at industry events (will attend multiple events in person).
REQUIREMENTS
- 1+ year of experience in a sales/lead generation role in a high-tech/SaaS company.
- Ability to develop strong, long-lasting relationships both internally and externally.
- Collaborative and coachable, always looking to improve your skills and impact.
- Ability to handle rejection and stay persistent in pursuing leads.
- Excellent verbal and written communication skills.
- A basic understanding of a standard SaaS seller's technical stack (CRM, Outreach/Salesloft, Prospect Research, etc.).
- Excellent time management, process, and prioritization skills.
- Preferred experience with Cloud or Security sales.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
As an Engineer on the Dedicated Inference team, you'll shape the state-of-the-art developer experience for deploying and operating AI workloads in production. From the CLI and SDKs to APIs, observability, and debugging workflows, you'll build the tools customers rely on every day to manage mission-critical inference deployments.
Few teams at Baseten have as much breadth and visibility as Dedicated Inference. The team is often at the forefront of new product development, giving engineers the opportunity to shape the experience of some of our most important customers.
EXAMPLE INITIATIVES
You'll get to work on these types of projects as part of our Dedicated Inference team:
- Chains for multi-component workflows https://www.baseten.co/blog/baseten-chains-explained/
- Asynchronous inference https://www.baseten.co/blog/using-asynchronous-inference-in-production/
- Model APIs for frontier models https://www.baseten.co/products/model-apis/
- Model training built for production inference https://www.baseten.co/products/training/
RESPONSIBILITIES
- Implement new features and products for the team
- Design ergonomic APIs and abstractions to solve customer problems
- Fix bugs and resolve customer issues with urgency
- Work across the stack - regardless of where you start, you’ll end up touching both React Components and Kubernetes Pods
- Work closely with the product and forward deployed engineering teams to develop and drive new product ideas
REQUIREMENTS
- Bachelor's degree or higher in Computer Science or related field
- Proficient coding abilities in one or more popular programming or scripting languages; Python, Go, or JavaScript proficiency is a plus
- Familiarity with web applications & databases
- Good taste in product, particularly developer-oriented tools
- Interest in ML/AI infrastructure and willingness to learn
- Strong collaboration and communication skills
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Location: San Francisco; Remote; Toronto; New York; Montreal; Seattle
Workplace: Hybrid
ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLE
As a Forward Deployed Engineer at Baseten, you will partner directly with customers to architect, build, and deploy high-scale production AI applications on Baseten’s platform. You’ll own the journey with customers from initial exploration to production deployment, translating ambiguous business goals into reliable, observable services with clear quality, latency, and cost outcomes.
This role is a great fit for entrepreneurial engineers who want a front-row view into how modern companies adopt AI at scale and who enjoy working across product, software development, performance engineering, and customer-facing implementations.
To be clear, this is an engineering role with hands-on coding and software development that also includes aspects of product management, technical customer success, and pre-sales solution engineering mixed in.
EXAMPLE INITIATIVES
Take a look at these blog posts written by members of our Forward Deployed Engineering team:
- Forward Deployed Engineering on the frontier of AI https://www.baseten.co/blog/forward-deployed-engineering/
- The fastest, most accurate Whisper transcription https://www.baseten.co/blog/the-fastest-most-accurate-and-cost-efficient-whisper-transcription/
- Deploy production-ready model servers from Docker images https://www.baseten.co/blog/deploy-production-model-servers-from-docker-images/
- Deploy custom ComfyUI workflows as APIs https://www.baseten.co/blog/deploying-custom-comfyui-workflows-as-apis/
RESPONSIBILITIES
- Develop and maintain software systems and product features using one or more general-purpose programming languages in a production-level environment, with a preference for Python due to its relevance in ML projects.
- Drive customer impact by designing, implementing, and deploying Baseten solutions end-to-end (problem framing → evaluation → production deployment → monitoring). This involves working with customers’ engineering teams at every stage of the customer journey including: sales, implementation, and expansion.
- Deliver with velocity: turn vague objectives into clear specs and well-defined PoCs so we can rapidly ship well-tested services and outcomes for our customers
- Optimize and enhance AI/ML projects, contributing to the continuous improvement of our technical stack. This includes developing features and PRDs with other engineering and product orgs.
- Own products and customer projects end-to-end, functioning as both an engineer, project manager, and product manager, with a focus on user empathy, project specification, and end-to-end execution.
- Navigate ambiguity and exercise good judgment on tradeoffs and tools needed to solve problems, avoiding unnecessary complexity.
- Demonstrate pride, ownership, and accountability for your work, expecting the same from your teammates.
REQUIREMENTS
- Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field.
- 2+ years of professional work experience in a fast-paced, high-growth environment.
- Demonstrated experience with one or more general-purpose programming languages in a production-level environment, with a strong preference for Python.
- Familiarity with AI/ML pipelines and the lifecycle of ML model development and deployment.
- Strong communication skills, particularly on complex technical topics.
- Experience in building or optimizing AI/ML projects is highly valued.
BENEFITS
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
ГибридSan Francisco
300 000 – 340 000 $
ГибридSan Francisco; Remote; Toronto; New York; Montreal; Seattle
165 000 – 330 000 $
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.