Задачи:
— Разработка ИИ-решений для образовательных систем
— Разработка автоматизированных пайплайнов для проверки и оценки ответов
— Проведение экспериментов с большими языковыми моделями (LLM), промптами и методами дообучения
— Подготовка, обработка и анализ данных
Требования:
— Опыт работы в Data Science, Machine Learning или NLP от 2 лет
— Хорошее знание основ машинного и глубокого обучения
— Уверенное владение Python
— Продвинутый уровень SQL
— Опыт работы с библиотеками для анализа данных и машинного обучения: NumPy, pandas, scikit-learn
Условия:
— Работа в офисе в Астане
Location: Remote - United States
Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit
www.redditinc.com
.
Reddit is looking for an experienced Engineering Manager to lead our Feed Retrieval team. In this role, you’ll lead a high-impact team of Machine Learning Engineers building the systems that identify, retrieve, and shape the candidate inventory powering Reddit’s personalized feeds. Your team will work at the foundation of Feed Relevance: expanding the set of high-quality content Reddit can recommend, improving personalization and discovery for users across different levels of signal, and building scalable ML systems that directly shape the experiences of over 120M+ daily users.
If applying ML / AI in production to improve Reddit Relevance excites you, then you’ve found the right place.
Responsibilities:
Define Technical Vision & Strategy:
Define the technical vision and long-term roadmap for Feed Retrieval, aligning large-scale recommender-system investments with Reddit’s product, ecosystem, and business objectives.
Roadmap & Prioritization:
Translate broad Feed Relevance goals into a focused team roadmap, making clear prioritization tradeoffs across model quality, inventory expansion, experimentation velocity, infrastructure cost, and operational reliability.
Team Leadership & Development:
Coach and support the development of your team, constantly seeking opportunities to grow their skills and impact.
Technical Execution & Delivery:
Oversee the design, development, and optimization of retrieval systems that source relevant, diverse, fresh, and high-quality candidates for personalized feed experiences.
Measurement & Learning:
Establish strong measurement, experimentation, and debugging practices so the team can understand retrieval quality, candidate coverage, source incrementality, and downstream impact.
Platform & Infrastructure Collaboration:
Collaborate with ML platform, infrastructure, ranking, safety, and product teams to build scalable, low-latency retrieval systems that can support the next generation of AI-powered recommendations.
Operational Excellence:
Maintain high standards for system performance, reliability, latency, cost efficiency, and responsible recommendation practices.
Cross-Functional Partnership:
Work with cross-functional partners from across the company to identify key areas of opportunity, set expectations, and communicate your team’s work.
Recruiting & Growth:
Partner with our incredible recruiting team to attract, interview, and hire diverse and talented machine learning engineers, growing a world-class team.
Qualifications:
Experience Leading ML Teams:
2+ years of experience building and managing high-performing ML or recommender-systems teams.
Deep ML Expertise:
Hands-on experience with large-scale production ML systems, ideally including recommender systems, retrieval models, embedding-based systems, sequence models, transformer-based architectures, or LLM-powered recommendation applications.
Technical Domain Knowledge:
Strong understanding of recommender systems, especially candidate retrieval, embedding/indexing systems, ranking handoffs, feed personalization, exploration, content quality, and measurement strategies.
Strategic Thinking:
Ability to develop and communicate a clear technical strategy across ambiguous problem spaces, balancing user relevance, ecosystem health, system scalability, and business impact.
Impact-Driven Mindset:
Passion for developing scalable, well-designed, and responsible AI solutions that drive business value.
Exceptional Communication & Collaboration:
Strong interpersonal skills and a collaborative mindset, with the ability to effectively communicate complex technical topics to diverse audiences and build strong relationships with cross-functional partners.
Benefits:
Comprehensive Healthcare Benefits and Income Replacement Programs
401k with Employer Match
Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support
Family Planning Support
Gender-Affirming Care
Mental Health & Coaching Benefits
Flexible Vacation & Paid Volunteer Time Off
Generous Paid Parental Leave
#LI-remote, #LI-JS5
Pay Transparency:
This job posting may span more than one career level.
In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit
https://www.redditinc.com/careers/
.
To provide greater transparency to candidates, we share base salary ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies. Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses/credentials, and may vary from the amounts listed below.
The base salary range for this position is:
$253,300
—
$354,600 USD
In select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews.
During the interview, we will collect the following categories of personal information: Identifiers, Professional and Employment-Related Information, Sensory Information (audio/video recording), and any other categories of personal information you choose to share with us. We will use this information to evaluate your application for employment or an independent contractor role, as applicable. We will not sell your personal information or disclose it to any third party for their marketing purposes. We will delete any recording of your interview promptly after making a hiring decision. For more information about how we will handle your personal information, including our retention of it, please refer to our
Candidate Privacy Policy for Potential Employees and Contractors
.
Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve. Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If, due to a disability, you need an accommodation during the interview process, please let your recruiter know.
УдалённоRemote - United States
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.
Location: Remote - United States
Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit
www.redditinc.com
.
Reddit is looking for an experienced Engineering Manager to lead our Feed Ecosystems team. In this role, you’ll lead a high-impact team of Machine Learning Engineers focused on building recommendation systems that support sustainable growth across users, posts, and communities. Your team will improve relevance for new, low-signal, and logged-out users; help new posts and communities find the right audiences; and develop ML systems that balance personalization, discovery, and ecosystem quality across Reddit’s 100,000+ active communities.
If applying ML / AI in production to improve Reddit Relevance and strengthen Reddit’s community ecosystem excites you, then you’ve found the right place.
Responsibilities:
Define Technical Vision & Strategy:
Define the technical vision and long-term roadmap for Feed Ecosystems, aligning recommender-system investments with Reddit’s goals around user growth, contribution, community health, and high-quality discovery.
Team Leadership & Development:
Coach and support the development of your team, constantly seeking opportunities to grow their skills and impact.
Cross-Functional Partnership:
Work closely with product, design, data science, safety, community, ads, and platform partners to identify opportunities, set expectations, and communicate your team’s work.
Technical Execution & Delivery:
Oversee the design, development, and optimization of ML systems that improve cold-start relevance, new post and community distribution, community discovery, and feed quality.
Quality & Ecosystem Measurement:
Help define and operationalize signals for subjective and objective quality, ensuring Feed systems optimize not only for engagement, but also for user value, community health, contribution, and long-term ecosystem outcomes.
Platform & Infrastructure Collaboration:
Collaborate with platform and infrastructure teams to build scalable AI-powered systems that support discovery, personalization, and healthy content distribution across Reddit.
Operational Excellence:
Maintain high standards for system performance, reliability, efficiency, and responsible AI practices in alignment with user needs and ecosystem health.
Recruiting & Growth:
Partner with our recruiting team to attract, interview, and hire diverse and talented machine learning engineers, growing a world-class team.
Qualifications:
Experience Leading ML Teams:
2+ years of experience building and managing high-performing ML or recommender-systems teams.
Deep ML Expertise:
Hands-on experience with large-scale production ML systems, ideally including recommender systems, personalization, cold-start modeling, content understanding, or LLM-powered recommendation applications.
Technical Domain Knowledge:
Strong understanding of recommender systems, including candidate retrieval, ranking, value modeling, ecosystem dynamics, and measurement strategies.
Strategic Thinking:
Ability to develop and communicate a clear, compelling technical strategy across ambiguous problem spaces, balancing user relevance, community growth, content quality, safety, and business impact.
Impact-Driven Mindset:
Passion for developing scalable, well-designed, and responsible AI systems that improve user value while supporting a healthy and sustainable content ecosystem.
Exceptional Communication & Collaboration:
Strong interpersonal skills and a collaborative mindset, with the ability to effectively communicate complex technical topics to diverse audiences and build strong relationships with cross-functional partners.
Benefits:
Comprehensive Healthcare Benefits and Income Replacement Programs
401k with Employer Match
Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support
Family Planning Support
Gender-Affirming Care
Mental Health & Coaching Benefits
Flexible Vacation & Paid Volunteer Time Off
Generous Paid Parental Leave
#LI-remote, #LI-JS5
Pay Transparency:
This job posting may span more than one career level.
In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit
https://www.redditinc.com/careers/
.
To provide greater transparency to candidates, we share base salary ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies. Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses/credentials, and may vary from the amounts listed below.
The base salary range for this position is:
$253,300
—
$354,600 USD
In select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews.
During the interview, we will collect the following categories of personal information: Identifiers, Professional and Employment-Related Information, Sensory Information (audio/video recording), and any other categories of personal information you choose to share with us. We will use this information to evaluate your application for employment or an independent contractor role, as applicable. We will not sell your personal information or disclose it to any third party for their marketing purposes. We will delete any recording of your interview promptly after making a hiring decision. For more information about how we will handle your personal information, including our retention of it, please refer to our
Candidate Privacy Policy for Potential Employees and Contractors
.
Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve. Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If, due to a disability, you need an accommodation during the interview process, please let your recruiter know.
Location: Paris; Amsterdam; London; Lausanne
Workplace: Hybrid
ABOUT MISTRAL
Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms.
We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited.
THE ROLE
Mistral AI is seeking Applied Scientists and Research Engineers to drive innovative research and collaborate with clients on complex research projects.
You will develop SOTA models across different modalities such as text, image, and speech. By developing novel methods and research ideas you will apply these models across a diverse set of use cases and domains. Working cross-functionally with both external and internal science, engineering, and product teams you will deliver high-impact AI solutions that turn the needle. We are made of researchers, engineers, product builders, ex-founders who love tackling the most complex real world problems in the industry.
WHAT YOU WILL DO
- Run pre-training, post-training and deploy state of the art models on clusters with thousands of GPUs.
- Work across a diverse set of complex real world problems such as robotics, engineering, finance, cybersecurity, physics and more.
- Generate and curate data for pre-training and post-training, working on evaluations and making sure the model's performance beats expectations.
- Develop the necessary tools and frameworks to facilitate data generation, model training, evaluation and deployment.
- Collaborate with cross-functional teams to tackle complex use cases using agents and retrieval pipelines.
- Manage research projects and communications with client research teams.
WHAT WE'RE LOOKING FOR
- Fluent in English with excellent communication skills — at ease explaining complex technical concepts to both technical and non-technical audiences.
- Expert with PyTorch or JAX.
- Not afraid of contributing to a big codebase; finds their way around independently with little guidance.
- Writes clean, readable, high-performance, fault-tolerant Python code.
- Doesn’t need roadmaps: moves independently and navigates uncertainty with confidence.
- Low-ego, collaborative and eager to learn.
- Track record of success through personal projects, professional projects or academia.
NICE TO HAVE
- Ex-founder or builder
- PhD / Master in a relevant field (Mathematics, Physics, Machine Learning) — exceptional candidates from other backgrounds welcome.
- Research experience in agents, multimodal models, world models, robotics, diffusion models, cybersecurity, 3D understanding/generation, or time-series analysis.
- Experience working on large code bases or large machine learning models at scale.
- Contributions to a large open-source or industry codebase.
- Publications in top academic journals or conferences.
- Enjoys improving existing code: typing, tests, CI pipelines.
WHAT WE OFFER
We offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks.
For the most up-to-date details on benefits available in your location, please refer to our Benefits page https://app.notion.com/p/mistralai/Benefits-at-Mistral-36e6ba59a7fe836b93dd01737fcc27ef?source=copy_link.
PRIVACY POLICY
Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy https://legal.mistral.ai/terms/applicant-privacy-policy.
Location: New York; San Francisco
Workplace: OnSite
ABOUT US:
AI NEEDS A NEW INFRASTRUCTURE LAYER. WE'RE BUILDING IT AT MODAL.
Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.
Our customers include category-defining companies like Ramp https://modal.com/blog/how-ramp-built-a-full-context-background-coding-agent-on-modal, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.
We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.
Our team includes creators of popular open-source projects (e.g.,Seaborn https://github.com/mwaskom/seaborn,Luigi https://github.com/spotify/luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.
THE ROLE:
We are looking for PhD research interns with strong research experience in reinforcement learning, machine learning, and foundation models, including large language and multimodal models, to join our research team.
WHAT YOU’LL WORK ON:
- Improve existing methods and develop new techniques for large-scale model training, optimization, and inference
- Extend models to long-context and long-horizon tasks
- Improve inference-time efficiency, reliability, and robustness in high-stakes real-world deployments
YOU MAY BE A FIT IF:
- You’re currently pursuing a PhD in computer science, machine learning, or a related field
- You have a demonstrated record of research in reinforcement learning, machine learning, foundation models, or related areas
- You have experience developing and evaluating large-scale models or machine learning systems
- You’re familiar with distributed training, large-scale inference, or multi-GPU environments
- You have publications at leading venues such as NeurIPS, ICML, ICLR, CVPR, CoRL, UAI, JMLR, or TMLR
- You have strong programming and engineering skills and can translate research ideas into working implementations
- You have a collaborative, mission-driven mindset and can work effectively across research and engineering teams
Workplace: fully
We're looking for a
Machine Learning Engineer
to help build and improve AI-powered products. You'll work with large datasets, train and evaluate machine learning models, and collaborate with software engineers to bring models into production.
This is a great opportunity for someone who enjoys solving practical problems with machine learning and wants to work on real-world AI applications.
What you'll do
Develop, train, and evaluate machine learning models.
Prepare and analyze datasets for model training.
Improve model performance through experimentation and testing.
Deploy and maintain ML models in production environments.
Collaborate with software engineers to integrate ML solutions into products.
Monitor model performance and continuously improve accuracy.
Stay up to date with new machine learning techniques and technologies.
What we're looking for
Basic understanding of machine learning concepts and algorithms.
Experience with Python.
Familiarity with machine learning libraries such as PyTorch, TensorFlow, or scikit-learn.
Comfortable working with data and writing clean, maintainable code.
Familiarity with Git.
Good problem-solving skills.
Strong written and verbal English communication.
Nice to have
Experience with large language models (LLMs).
Experience with cloud platforms such as AWS, GCP, or Azure.
Familiarity with SQL.
Experience deploying ML models.
Personal projects or open-source contributions related to AI or machine learning.
Requirements
1+ year of experience in machine learning, software engineering, data science, or a related technical role
or
strong personal projects demonstrating ML skills.
Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field is a plus, but not required.
Passion for learning and building AI solutions.
What we offer
Fully remote work.
Flexible working environment.
Opportunity to work on real AI products.
Challenging technical problems with room to grow.
Collaborative and fast-moving team.
Competitive compensation based on experience.
Задачи:
- Разработка co-pilot решения на базе данных RAG и применении LLM
- Разработка и интеграция AI-агентов, исследование новых поверхностей взаимодействия с AI
- Разработка микросервисов на Python в качестве MCP инструментов
- Анализ требований, формализация функционала, проектирование архитектуры взаимодействия агентов и сервисов
- Участие в планировании, декомпозиции задач и оценке сложностей, планировании спринтов на основе SCRUM церемоний
- Проведение код-ревью, поддержание высокого стандарта качества и чистоты кода
- Тесное взаимодействие с командой на всех этапах разработки
- Участие в подготовке и выпуске релизов, взаимодействие со смежными подразделениями
- Документирование своей работы и менторство джуниор-разработчиков
Требования:
- Опыт коммерческой разработки на Python от 4 лет
- Уверенное знание Python 3.7+ (в проекте используется 3.12+)
- Понимание и успешный опыт применения паттернов проектирования (GoF, SOLID, GRASP)
- Опыт проведения код-ревью и работы по GitFlow
- Опыт разработки агентных систем с помощью langchain, langgraph и успешное внедрение в промышленную среду
- Опыт разработки приложений, основанных на микросервисной архитектуре
- Уверенное знание SQL и понимание принципов работы реляционных СУБД (PostgreSQL)
- Опыт написания unit-тестов
- Опыт разработки асинхронных приложений на Python
- Понимание жизненного цикла разработки приложений в контексте Agile
- Опыт и желание работать в команде, умение аргументировать свои решения и договариваться
Условия:
- Возможность участия в интересном проекте
- Возможность профессионального и карьерного роста в компании
- Опыт работы в команде профессионалов
- Уровень заработной платы обсуждается индивидуально
- Удаленный формат работы и офисный формат в Москве
Location: Europe; United States
Workplace: Remote
ABOUT CANTINA:
Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.
If you're excited about the potential AI has to shape human creativity and social interactions, join us in building the future!
ABOUT THE ROLE:
We are looking for an ML Engineer to own the production inference stack for our text-to-speech (TTS) and speech recognition (ASR) models, end to end. Our research team delivers trained model checkpoints; you will productionize them as low-latency, real-time streaming services that run cost-efficiently on GPUs. The role covers the inference engines, the Kubernetes infrastructure they run on, and the performance benchmarking and accuracy validation that let us ship changes safely. You will bridge research and production, and own latency, throughput, cost and accuracy as we scale.
WHAT YOU’LL DO:
- Build and optimize streaming inference engines for TTS and ASR models, including multi-stage model pipelines.
- Optimize latency (time to first chunk, p50/p99) and throughput using continuous batching, CUDA Graphs, torch.compile and mixed precision.
- Maintain numerical parity with the reference implementation through automated accuracy regression tests, per stage and end to end.
- Deploy and operate GPU inference services on Kubernetes: autoscaling, containerization and infrastructure as code.
- Build CI/CD for model artifacts, with model versioning and reproducible releases.
- Own observability and performance benchmarking: p50/p99 latency, real-time factor (RTF), GPU utilization and cost per request.
- Partner with research to productionize new models.
WHAT YOU’LL BRING:
- Hands-on experience deploying, scaling and optimizing ML models in production, beyond consuming model APIs.
- Working knowledge of the full inference stack, from CUDA kernels to serving frameworks, with depth in some layers; expertise across all of them is not expected.
- GPU performance optimization: profiling (Nsight Systems, PyTorch Profiler), memory bandwidth, CPU-GPU synchronization.
- Solid understanding of model serving: continuous batching, KV cache management, request scheduling.
- Production experience with Kubernetes, CI/CD and cloud infrastructure.
- Strong Python and PyTorch, and a rigorous approach to performance benchmarking.
- Experience with speech or audio models (TTS, ASR, voice conversion).
- Experience with inference frameworks such as vLLM (vLLM-Omni), SGLang, TensorRT-LLM, TensorRT or Triton Inference Server.
COMPENSATION:
When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.
BENEFITS FOR U.S.-BASED ROLES:
- Competitive salary and generous company equity
- Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
- 42 days of paid time off, including:
- 15 PTO days
- 10 sick days
- 15 company holidays
- 2 floating holidays
- Generous parental leave & fertility support
- 401(k) retirement savings plan
- Lifestyle spending account – $500/month to use however you’d like
- Complimentary lunch and snacks for in-office employees
- One Medical membership, and more!
Задачи:
- Поддержка и развитие существующих AI-модулей системы онлайн-прокторинга
- Определение отсутствия лица и нескольких лиц в кадре
- Реализация Face ID и проверки личности пользователя
- Разработка Liveness-проверки (моргание, улыбка, движения головы, контроль дистанции до камеры)
- Определение поворотов головы и направления взгляда
- Анализ положения тела и правильности посадки пользователя
- Выявление ухода пользователя из кадра и поворота от рабочей зоны
- Обнаружение посторонних людей и объектов в кадре
- Детекция смартфонов, наушников, часов и других гаджетов
- Распознавание мониторов, ноутбуков, клавиатур, мышей и других объектов рабочего места
- Определение посторонних движений и плохого освещения
- Снижение количества ложных срабатываний моделей
- Обучение, дообучение и замена AI-моделей
- Оптимизация моделей с использованием CUDA
- Интеграция AI-модулей через API
- Развертывание локальных LLM на собственных серверах
- Работа с моделями Qwen, Llama, Mistral, Gemma и другими open-source LLM
- Интеграция GPT, Claude, Gemini и других LLM через API
- Подбор и оптимизация AI-моделей под задачи продукта
- Внедрение новых AI-библиотек и технологий
Требования:
- Уверенное владение Python
- Практический опыт работы с Computer Vision
- Практический опыт работы с LLM
- Опыт локального развертывания open-source LLM
- Опыт интеграции облачных LLM через API
- Умение работать с существующим кодом и готовыми моделями
- Опыт запуска и оптимизации моделей на GPU
- Готовность поддерживать существующие AI-модули и разрабатывать новые
- Самостоятельность и умение доводить решения до production
- Проживание в Астане
Будет плюсом:
- Опыт работы с Hugging Face и Ollama/vLLM
- Опыт использования TensorRT, ONNX и OpenVINO
- Опыт разработки систем реального времени
- Опыт создания AI-продуктов для Computer Vision
Условия:
- Полная занятость
- Возможна стажировка
- Официальное трудоустройство
- Формат работы: удаленно
- График 5/2 или свободный
- Рабочий день — 8 часов или по договоренности
- Заработная плата от 400 000 до 600 000 ₸ до вычета налогов
- Долгосрочная работа над действующим AI-продуктом
- Формат работы и уровень оплаты обсуждаются индивидуально
УдалённоПроживание в Астане; Астана (удаленная работа, рассматриваются кандидаты только из Астаны)
Location: Singapore
About the Company
Our client is a stealth AI startup backed by one of Southeast Asia's leading technology companies and is currently building its global founding team.
The company is developing an AI-native communication platform designed to simplify everyday tasks by integrating AI directly into conversations. Instead of switching between multiple applications, users can plan, organize, compare, research, and complete tasks within a single intelligent assistant.
Serving a market of billions of users still relying on traditional productivity tools, the platform focuses on delivering reliable AI workflows, persistent context, multi-step reasoning, and seamless task execution. The mission is to create an AI assistant that significantly improves productivity while making everyday work simpler and more intuitive.
About the Role
Our client is seeking a
VP of Research (Machine Learning)
to define and lead the research direction behind its AI platform. This leadership role will shape how AI systems reason, learn, evaluate, and continuously improve within a product designed for high-frequency, real-world usage.
Working closely with product and engineering leadership, this position will drive the long-term intelligence strategy, balancing cutting-edge research with practical production impact.
Key Responsibilities
Define and evolve the research roadmap for the platform's core AI intelligence, including context representation, memory, reasoning, planning, and orchestration.
Evaluate and determine when to develop proprietary model architectures versus leveraging or adapting frontier open-source and commercial AI models.
Design evaluation frameworks that measure real-world performance, robustness, safety, and long-term system behavior beyond traditional benchmark metrics.
Lead the company's AI alignment, safety, and guardrail strategy as a core component of product development.
Drive research and experimentation across advanced machine learning techniques, including:
Retrieval-Augmented Training (RAG)
Mixture of Experts (MoE)
Model Distillation
Multi-Agent Orchestration
Multimodal AI Systems
Partner closely with product and engineering teams to define and execute the intelligence strategy for AI-powered applications.
Establish and maintain high standards for research quality, technical judgment, and engineering excellence across the organization.
Requirements
Extensive experience designing, building, and deploying machine learning systems in production environments.
Strong technical expertise in model behavior, failure analysis, system evaluation, and long-term AI performance.
Proven ability to translate advanced research into reliable, production-ready AI solutions.
Demonstrated experience making high-impact technical decisions in fast-moving and ambiguous environments.
Deep understanding of AI evaluation methodologies, model robustness, safety, and system reliability.
Strong ownership mindset with the ability to lead technical strategy and execution.
Passion for building practical AI systems that deliver measurable real-world impact rather than focusing solely on academic research or benchmark performance.
Preferred Technical Skills
Experience with the following technologies is preferred:
Python
PyTorch and/or JAX
GPU-based model training and inference systems
Location: Singapore
About the Company
Our client is a stealth AI startup backed by one of Southeast Asia's leading technology companies and is currently building its global founding team.
The company is developing an AI-native communication platform designed to simplify everyday tasks by integrating AI directly into conversations. Instead of switching between multiple applications, users can plan, organize, compare, research, and complete tasks within a single intelligent assistant.
Serving a market of billions of users still relying on traditional productivity tools, the platform focuses on delivering reliable AI workflows, persistent context, multi-step reasoning, and seamless task execution. The mission is to create an AI assistant that significantly improves productivity while making everyday work simpler and more intuitive.
About the Role
Our client is seeking a
Technical Lead, Machine Learning
to lead the execution of its AI platform by translating research into scalable, production-ready machine learning systems. This role sits at the intersection of research, infrastructure, and product, with responsibility for ensuring models are trainable, deployable, observable, and optimized for real-world performance.
Working closely with research, engineering, and product teams, this position will drive the development of robust ML infrastructure while balancing performance, reliability, latency, and cost.
Key Responsibilities
Lead the end-to-end execution of machine learning systems, including data pipelines, training workflows, evaluation frameworks, inference architecture, and production deployment.
Fine-tune and optimize models using modern techniques such as
LoRA, QLoRA, Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and model distillation
.
Design, build, and operate scalable inference systems with a focus on latency, cost efficiency, and reliability.
Develop and maintain data pipelines for both synthetic and real-world training datasets.
Build evaluation frameworks to measure model performance, robustness, safety, and bias in collaboration with research teams.
Optimize production deployments through GPU utilization, memory efficiency, inference optimization, and scaling strategies.
Partner closely with application engineering teams to integrate machine learning systems into backend, desktop, and mobile products.
Continuously improve production systems through rapid iteration, monitoring, and data-driven optimization.
Requirements
Proven experience building and deploying production-grade machine learning systems used by real users.
Strong expertise working with large language models and understanding model behavior, limitations, and failure modes.
Experience developing scalable ML infrastructure, training pipelines, and inference systems.
Strong software engineering skills with the ability to write maintainable, production-quality code.
Experience balancing real-world production constraints, including latency, reliability, scalability, cost, and safety.
Strong ownership mindset with the ability to independently drive technical initiatives from design through deployment.
Excellent communication and collaboration skills, with experience working in cross-functional, high-performing engineering teams.
Preferred Technical Skills
Experience with the following technologies is preferred:
Python
PyTorch and/or JAX
GPU-based model training and inference systems
Location: Singapore
About the Company
Our client is a stealth AI startup backed by one of Southeast Asia's leading technology companies and is currently building its global founding team.
The company is developing an AI-native communication platform designed to simplify everyday tasks by integrating AI directly into conversations. Instead of switching between multiple applications, users can plan, organize, compare, research, and complete tasks within a single intelligent assistant.
Serving a market of billions of users still relying on traditional productivity tools, the platform focuses on delivering reliable AI workflows, persistent context, multi-step reasoning, and seamless task execution. The mission is to create an AI assistant that significantly improves productivity while making everyday work simpler and more intuitive.
About the Role
Our client is seeking a
Senior Machine Learning Engineer
to design and build production-grade machine learning systems that power its AI platform. This is a hands-on technical role focused on solving complex machine learning challenges, translating research into scalable solutions, and delivering reliable AI systems that operate effectively in real-world environments.
Working closely with research, product, and engineering teams, this position will independently own critical machine learning components from development through production deployment.
Key Responsibilities
Build and develop core machine learning systems that power AI-driven product capabilities.
Own the end-to-end machine learning lifecycle, including data preparation, model training, evaluation, inference, deployment, and continuous iteration.
Translate research concepts into reliable, production-ready machine learning solutions.
Investigate and resolve model performance issues and production system failures using real-world operational insights.
Continuously improve machine learning systems through rapid experimentation, measurement, and iteration.
Collaborate closely with research, product, and engineering teams to deliver impactful AI features.
Provide technical guidance through code reviews, best practices, and mentorship of fellow machine learning engineers.
Develop solutions that balance real-world production requirements, including latency, scalability, cost efficiency, reliability, and safety.
Requirements
Proven experience building and deploying production machine learning systems used by real users.
Strong understanding of modern machine learning models, including their behavior, limitations, and failure modes in production environments.
Excellent software engineering skills with the ability to develop robust, maintainable, production-quality systems.
Experience designing and implementing scalable machine learning pipelines and infrastructure.
Strong ownership mindset with the ability to independently solve complex technical challenges from concept through deployment.
Excellent problem-solving, communication, and collaboration skills within cross-functional engineering teams.
Demonstrated ability to iterate quickly and continuously improve machine learning systems based on production feedback.
Preferred Technical Skills
Experience with the following technologies is preferred:
Python
PyTorch and/or JAX
GPU-based training and inference systems
Location: Singapore
About the Company
Our client is a stealth AI startup backed by one of Southeast Asia's leading technology companies and is currently building its global founding team.
The company is developing an AI-native communication platform designed to simplify everyday tasks by integrating AI directly into conversations. Instead of switching between multiple applications, users can plan, organize, compare, research, and complete tasks within a single intelligent assistant.
Serving a market of billions of users still relying on traditional productivity tools, the platform focuses on delivering reliable AI workflows, persistent context, multi-step reasoning, and seamless task execution. The mission is to create an AI assistant that significantly improves productivity while making everyday work simpler and more intuitive.
About the Role
Our client is seeking a
Principal Machine Learning Engineer
to build and deploy production-grade machine learning systems that power its AI platform. This role focuses on translating research into scalable solutions by developing robust training pipelines, inference systems, evaluation frameworks, and deployment infrastructure.
Working closely with research and application engineering teams, this position will play a key role in delivering reliable, high-performance ML systems that operate effectively under real-world production constraints.
Key Responsibilities
Build and own end-to-end machine learning pipelines covering data processing, model training, evaluation, inference, and deployment.
Fine-tune and adapt models using modern techniques such as LoRA, QLoRA, Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and model distillation.
Design and operate scalable inference systems while balancing latency, cost, and reliability.
Develop and maintain data pipelines for both synthetic and real-world training datasets.
Build evaluation frameworks to assess model performance, robustness, safety, and bias in collaboration with research teams.
Optimize production deployments through GPU optimization, memory efficiency, latency reduction, and scaling strategies.
Collaborate with application engineering teams to integrate machine learning systems into backend, mobile, and desktop applications.
Continuously improve ML systems through rapid iteration and real-world performance monitoring while balancing production constraints such as latency, cost, reliability, and safety.
Requirements
Strong background in deep learning and transformer-based architectures.
Hands-on experience training, fine-tuning, or deploying large-scale machine learning models in production.
Proficiency with modern machine learning frameworks such as
PyTorch
or
JAX
.
Experience with distributed training and inference frameworks, including technologies such as
DeepSpeed, FSDP, Megatron, ZeRO, or Ray
.
Strong software engineering skills with experience building robust, maintainable, production-grade systems.
Experience optimizing GPU workloads, including memory efficiency, quantization, and mixed precision.
Ability to independently own end-to-end machine learning systems in fast-moving environments.
Strong problem-solving skills with a focus on rapid iteration and continuous improvement.
Preferred Qualifications
Experience with one or more of the following is preferred:
LLM inference frameworks such as
vLLM, TensorRT-LLM, or FasterTransformer
Open-source contributions to machine learning or systems libraries
Scientific computing, compiler technologies, or GPU kernel development
Reinforcement Learning from Human Feedback (RLHF) pipelines, including
PPO, DPO, or ORPO
Training or deploying multimodal or diffusion models
Large-scale data processing frameworks such as
Apache Arrow, Spark, or Ray
Задачи:
— Разработка и внедрение AI агентов и моделей машинного обучения
— Создание и экспериментирование с GenAI моделями и агентными рабочими процессами
Требования:
— Владение Python и другими релевантными языками программирования
— 3 года практического опыта с фреймворками и библиотеками машинного обучения (TensorFlow, PyTorch или аналогичные)
— 2 года практического опыта в разработке и развертывании AI агентов и моделей машинного обучения
— Глубокие знания облачных технологий, с акцентом на Microsoft Azure, включая платформы Azure Data и AI (Databricks, Fabric, AI Foundry)
Location: Palo Alto, California, United States
About Nebius:
Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.
Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.
Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.
The role
As a Senior Machine Learning Engineer on the Applied AI team at Nebius Token Factory, you will own model and endpoint optimization from model artifacts through production deployment. Your work will span model internals, quantization and model compression, speculative decoding, KV-cache optimization, inference engines, serving architecture, and benchmarking to improve latency, throughput, memory efficiency, GPU utilization, and cost per token while preserving model quality and reliability.
You will work with kernel and platform engineers to investigate serving problems, compare configurations, and resolve performance and quality regressions. You will evaluate model-and engine-level optimizations together with distributed inference designs, including request routing, scheduling, prefill/decode coordination, and multi-node GPU execution. Your improvements will be validated through reproducible benchmarks and safe production rollouts under real-world workloads.
Your responsibilities
:
Own optimization projects for specific model families, customer endpoints, or serving backends.
Compare inference engines and recommend practical serving configurations suited to individual workloads.
Diagnose model-quality and performance regressions during production rollouts.
Improve LLM and
VLM
endpoint latency, throughput, memory efficiency, GPU utilization, quality, and cost per token.
Deploy, configure, benchmark, and extend inference engines such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, and
NVIDIA
Dynamo.
Develop production model-compression workflows covering quantization, quantization-aware training, distillation, low-bit serving, and accuracy recovery.
Implement or integrate speculative decoding, draft-model approaches,
KV
-cache optimization, prefix caching, chunked prefill, continuous batching, and disaggregated prefill/decode serving. For prefill/decode disaggregation (PDD), evaluate KV-cache transfer, worker placement, and capacity balancing to determine which workloads benefit from the architecture.
Design and improve LLM request routers and scheduling policies that balance worker utilization queuing, request characteristics, and KV-cache locality while meeting latency and reliability targets
Scale dense and mixture-of-experts inference across multiple GPU nodes. Select and tune tensor, pipeline, data, and expert parallelism - including wide expert parallelism (WideEP) - with attention to hardware topology, expert load balance, and communication overhead.
Build reproducible benchmark harnesses measuring for
TTFT
,
TPOT
, tokens per second per GPU, p95/p99 latency, GPU memory, reliability, and cost per token. Validate architecture choices under representative traffic and consistent GPU budgets.
Collaborate with GPU kernel engineers and platform engineers to trace bottlenecks across model code, kernels, runtime, scheduler, gateway, and cluster layers.
Produce design documents, performance reports, rollout plans, and customer-facing technical explanations.
Must-haves
:
Strong engineering skills in Python and PyTorch.
Hands-on experience deploying or optimizing LLM,
VLM
, or high-throughput transformer inference.
Practical knowledge of at least one modern inference stack, such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server,
NVIDIA
Dynamo, Ray Serve, KServe, or an equivalent internal system.
A strong understanding of transformer inference bottlenecks involving
KV
cache, attention, memory bandwidth, batching, parallelism, and long-context serving.
Ability to quantify trade-offs among latency, throughput, quality, utilization, and cost.
Experience designing or optimizing distributed inference system architecture, with hands-on work in one or more areas such as request routing, distributed scheduling, PDD, multi-node inference, or expert parallelism.
Strong communication skills and collaboration skills across research, kernel, infrastructure, product, and customer teams.
Nice
-
to
-
have
s
:
Experience with quantization-aware training, post-training quantization,
FP8
,
INT8
,
INT4
,
NVFP4
,
MXFP4
,
AWQ
,
GPTQ
, SmoothQuant.
Experience with distillation, speculative decoding, EAGLE, Medusa, multi-token prediction, or related inference acceleration methods.
Experience supporting agentic workloads involving including tool calling, structured outputs, streaming APIs, high concurrency, and multi-step orchestration.
Familiarity with CUDA
or Triton; the role does not require kernel engineering to be the candidate's primary specialization.
Contributions to open-source projects such as vLLM, SGLang, TensorRT-LLM, FlashInfer, LMCache, PyTorch, Triton, Ray, or KServe.
Implementation experience with cache-aware request routing, PDD, or WideEP, including diagnosing communication bottlenecks and load imbalance.
Familiarity with GPU communication libraries and interconnects, such as NCCL, NVLink, Infiniband, or RoCE.
Key employee benefits in the US:
Health insurance:
100% company-paid medical, dental, and vision coverage for employees and families.
401(k) plan:
Up to 4% company match with immediate vesting.
Parental leave:
20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.
Remote work reimbursement:
Up to $85/month for mobile and internet.
Disability & life insurance
: Company-paid short-term, long-term and life insurance coverage.
#LI-BH3
Pay Transparency
We offer competitive compensation and benefits packages. Actual compensation will be determined based on job-related factors, including experience, skills, qualifications, the level at which the candidate is hired, and geographic location, consistent with applicable law.
Base Compensation Range
$195,200
—
$262,200 USD
Benefits & Perks:
Competitive compensation
Career growth and learning opportunities
Flexibility and ownership
Collaborative and innovative culture
Opportunity to work on impactful AI projects
International environment and talented teams
What's it like to work at Nebius:
Fast moving - Bold thinking - Constant growth - Meaningful impact - Trust and real ownership - Opportunity to shape the future of AI
Equal Opportunity Statement:
Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.
Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.
If you need accommodations during the application process, please let us know.
Location: Palo Alto, California, United States
About Nebius:
Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.
Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.
Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.
The role
Nebius Token Factory is looking for scientists who can turn frontier LLM and VLM inference bottlenecks into research questions, conduct rigorous experiments, and translate their findings into production capabilities. You will own focused research and optimization projects, write strong code, and produce prototypes, publications, and technical artifacts that engineers can build on.
Your research will span quantization, distillation, speculative decoding, KV-cache optimization, and model/runtime co-optimization, alongside inference engines and distributed inference architectures. You will investigate how these approaches interact, evaluate their trade-offs across model quality, latency, throughput, memory footprint, and cost per token, and work with engineering teams to bring promising results into production.
Your responsibilities
:
Lead research projects in efficient LLM and VLM inference, from hypotheses and experiments through ablations, prototypes, and production handoff.
Develop and evaluate methods spanning quantization, quantization-aware training (QAT), distillation, speculative decoding, KV-cache reuse, KV-cache compression, long-context inference, MoE routing, and model/runtime co-optimization.
Build prototypes using PyTorch, Triton, CUDA-adjacent tooling, or inference-serving frameworks, and collaborate with MLEs and platform engineers to turn them into production components.
Research LLM request routing and scheduling strategies, including cache-aware load balancing and prefill–decode disaggregation (PDD). Evaluate how queueing, KV-cache transfer, worker placement, and prefill/decode capacity allocation affect latency, throughput, and serving cost.
Investigate multi-node inference for dense and mixture-of-experts models, including wide expert parallelism (WideEP). Study expert placement, load imbalance, and computation/communication trade-offs, and use the findings to guide model and system architecture choices.
Develop rigorous evaluations covering quality, latency, throughput, numerical stability, memory footprint, tail latency, and cost per token. Compare serving architectures under consistent workload conditions and GPU budgets.
Work with MLE, GPU kernel, backend infrastructure, product, and customer teams to select research priorities with measurable production impact.
Share results through internal reports, technical blogs, papers, and open-source artifacts, and mentor engineers and scientists on experimental design, scientific rigor, and model/system trade-offs.
Must-haves
:
A PhD in computer science, machine learning, ML systems, computer systems, computer architecture, electrical engineering, applied mathematics, or a closely related discipline.
A strong publication record or equivalent research artifacts in ML, ML systems, efficient inference, model compression, quantization, distillation, serving systems, or related areas.
Strong Python and PyTorch implementation skills, with the ability to turn ideas into experiments and working prototypes.
Deep knowledge of LLMs, VLMs, transformer inference, decoding algorithms, model compression, quantization, and production-serving trade-offs.
Strong experimental design skills covering ablations, baselines, metrics, statistical reasoning, and failure analysis.
Excellent written and verbal communication.
Nice
-
to
-
have
s
:
First-author publications at venues such as NeurIPS, ICML, ICLR, MLSys, ACL, EMNLP, ASPLOS, OSDI, SOSP, ISCA, or HPCA.
Experience deploying ML models or inference optimizations in production.
Experience with vLLM, SGLang, TensorRT-LLM, NVIDIA Dynamo, FlashAttention, FlashInfer, Triton, CUDA, or PyTorch internals.
Experience applying post-training, SFT, DPO, RLHF, RLAIF, preference optimization, or synthetic data generation to inference quality or efficiency.
Open-source research artifacts, widely used benchmarks, technical blogs, or invited talks demonstrating contributions to efficient AI systems.
Research or implementation experience in one or more areas of distributed inference system architecture, such as LLM request routing, PDD, multi-node serving, or MoE expert parallelism, including WideEP.
Key employee benefits in the US:
Health insurance:
100% company-paid medical, dental, and vision coverage for employees and families.
401(k) plan:
Up to 4% company match with immediate vesting.
Parental leave:
20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.
Remote work reimbursement:
Up to $85/month for mobile and internet.
Disability & life insurance
: Company-paid short-term, long-term and life insurance coverage.
Pay Transparency
We offer competitive compensation and benefits packages. Actual compensation will be determined based on job-related factors, including experience, skills, qualifications, the level at which the candidate is hired, and geographic location, consistent with applicable law.
Base Compensation Range
$195,200
—
$262,200 USD
Benefits & Perks:
Competitive compensation
Career growth and learning opportunities
Flexibility and ownership
Collaborative and innovative culture
Opportunity to work on impactful AI projects
International environment and talented teams
What's it like to work at Nebius:
Fast moving - Bold thinking - Constant growth - Meaningful impact - Trust and real ownership - Opportunity to shape the future of AI
Equal Opportunity Statement:
Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.
Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.
If you need accommodations during the application process, please let us know.
УдалённоRemote - United States
ГибридParis; Amsterdam; London; Lausanne; PhD / Master in a relevant field (Mathematics, Physics, Machine Learning) — exceptional candidates from other backgrounds welcome; Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks