Дата-инженер вакансии - удалённо

– Поддержка заинтересованных сторон: проверка данных по мере необходимости, расследование расхождений между панелями мониторинга, обеспечение доступности платформы бизнес-аналитики. – Разработка и поддержка ETL/ELT-конвейеров для аналитических отчетов (когортичный доход, LTV, удержание, KPI по креативам, аналитика после покупки).

▫️Проектирование, разработка и поддержка масштабируемых data ingestion pipelines. ▫️Работа с большими объёмами данных — до миллиардов строк.

▫️Архитектура Lakehouse / DWH. Проектирование и построение end-to-end архитектуры хранилища данных с нуля в среде Microsoft Fabric.

Проектирование и построение end-to-end архитектуры хранилища данных с нуля в среде Microsoft Fabric. Реализация многоуровневой архитектуры хранения данных по модели Medallion — Bronze, Silver, Gold — на основе Delta Lake (Parquet).

▫️Проектирование, разработка и поддержка масштабируемых data ingestion pipelines. ▫️Работа с большими объёмами данных — до миллиардов строк.

Проектирование и построение end-to-end архитектуры хранилища данных с нуля в среде Microsoft Fabric. Реализация многоуровневой архитектуры хранения данных по модели Medallion — Bronze, Silver, Gold — на основе Delta Lake (Parquet).

Distributed systems, MPP, Python / Go, AWS, Karpenter, Istio, database infrastructure и задачи, в которых можно влиять на то, как все работает вместе.

– Обеспечьте сквозную доставку одного или нескольких приоритетных доменов данных в Azure Databricks. – Разработка и создание конвейеров обработки данных уровня Medallion (Bronze/Silver/Gold) с использованием декларативных конвейеров Lakeflow, Auto Loader, Structured Streaming и Delta Lake с кластеризацией Liquid.

Location: United States & Canada Workplace: Remote About WorkOS 🚀 WorkOS builds modern developer tools and APIs that make it easy for companies to become Enterprise Ready. Our platform powers authentication, identity, authorization, and other critical infrastructure that developers need to securely scale their products to large organizations. We recently raised a $100M Series C, valuing the company at $2B, led by Meritech and Sapphire with participation from Greenoaks, Craft, Abstract, and Audacious. WorkOS powers enterprise features for many of the fastest-growing AI companies, including OpenAI, Cursor, and Perplexity, Sierra, and Plaid. As AI reshapes software, WorkOS is at the frontier of Human and Agent Authentication, Identity, and Access Control helping companies answer a new critical question: who are your agents, and what are they allowed to do? Our fast-growing customer base includes hundreds of modern software companies building the next generation of enterprise-ready products. ABOUT THE ROLE The Data team at WorkOS plays a central role on the company operations to ensure information and insights are accurate and available from any surface, whether that's a visualization tool or an agent's response, to accelerate company growth and scale. The team owns WorkOS's internal data platform end to end: ingestion, orchestration, the Snowflake warehouse, dbt transformations, governance and access controls. We also own the consumption layer: the reverse-ETL syncs that land data in Salesforce and Slack, the semantic views that agents query, the definitions that keep reporting consistent across the company, and the visualization tooling the company uses (ask us about Flashboards https://workos.com/blog/reporting-tool-with-no-editor). We run on an agent-first operating system: we are a lean team that moves fast, we document so agents can execute, and AI agents query the warehouse, run our runbooks, and open pull requests alongside us. We trust each other's expertise, we work out loud and in the open, and not opposed to rapid experimentation to get to the right solution for the business. We're hiring a Data Engineer to own and evolve the systems that move, transform, protect, and serve data across our internal warehouse. This is a high-ownership role on a lean team: you will be the DRI for the platform and its core data models, partner directly with Product Engineering, RevOps, Finance, GTM Engineering, and Security, and raise the bar on reliability, correctness, and operational rigor. The role spans the platform and what runs on it. You will own ingestion, orchestration, and access governance; the dbt models and metric definitions that depend on them; and how AI is applied across the data stack, so that trusted data is easy for both people and AI agents to discover, understand, and work with. You don't need to have done this exact job before. The best data engineers at WorkOS are the ones who notice in a Slack thread that a number doesn't match, trace it from the dashboard through the Gold model to the connector, fix the connector, and confirm the definition with its owner before the weekly review. When a business team asks for a field in Salesforce, they don't hand it off; they build the model, write the sync, and add the test. They would rather automate the runbook than run it a third time. They enjoy collaboration with different parts of the business and can find simple, scalable solutions to ambiguous problems. If that sounds like how you work, we want to talk. RESPONSIBILITIES - Own the reliability, freshness, and scaling of the ingestion and orchestration pipelines that land source data in Snowflake, including monitoring, alerting, runbooks, and backfill and reprocessing patterns - Design, build, and scale the core dbt models (Bronze, Silver, Gold) for billing and usage, CRM, product events, and GTM funnel reporting - Partner with Product, Finance, RevOps, and GTM to define metrics and codify them in the warehouse, and diagnose and resolve data quality and freshness issues at source, not just downstream - Own Snowflake RBAC, dynamic masking, and PII classification for humans, agents, and service accounts, so sensitive data is protected without blocking legitimate use, and review DDL and access requests from Engineering and GTM - Own the reverse-ETL layer and the runbooks that deliver warehouse data to Salesforce, Slack, and internal agents - Extend the semantic views, context, and evaluations that let agents answer business questions accurately, and expand what agents can operate directly, from runbooks and ingestion to pull requests - Build and advance the CI/CD review gates in the data-platform monorepo, including the automated review that agent-authored pull requests pass through - Own the infrastructure the data platform runs on: the compute, deployments, secrets and access patterns, and environments behind ingestion and orchestration, with attention to availability and failure modes, in partnership with our infrastructure engineers Example problems you might work on, possible paths rather than a fixed roadmap: - Standardizing how Postgres and SaaS sources are ingested, and consolidating end-to-end pipeline deployment and orchestration in Prefect - Managing Snowflake RBAC, resource management, and masking policies as code with Terraform - Using query history to improve analytics tables and semantic views, and to keep agent answers accurate and consistent as data grows and metrics shift - Automating masking coverage as new data sources arrive, so adding a new table no longer needs a human in the loop - Automating near-certain matches in the Identity Graph - Pseudonymizing product data in the ingestion path, alongside compliance and data-deletion policies - Extending transcript aggregation across sources, including PII detection before transcripts enter the warehouse - Building the reverse-ETL framework and runbooks that deliver data to other tooling and agents - Running self-hosted data services on Kubernetes and managing their AWS resources (IAM, storage, secrets) as code with Terraform QUALIFICATIONS - 5+ years (or equivalent) building and operating production data platforms, including the transformation layer - Deep experience with Snowflake, dbt, and an orchestrator such as Prefect, Airflow, or Dagster, and with ingesting data from production databases and SaaS sources, including backfill and reprocessing patterns - Experience running data systems in production: monitoring, alerting, debugging, incident response habits, and pragmatic SLO/SLA thinking - Experience with warehouse access governance: RBAC, masking policies, and PII handling - Strong data modeling judgment and an understanding of schema evolution - Strong SQL and Python; disciplined engineering practices (tests, docs, reviews, CI/CD) - Proven experience operating as the only engineer on a layer, balancing foundational architecture with urgent business needs - Working knowledge of how GTM, Finance, and Product teams operate in addition to working with Engineering, and experience translating ambiguous business questions into technical specs - Comfortable using LLMs and coding agents as part of your day-to-day development workflow, with the judgment to validate their output and scale it into shared processes, and embracing AI and automation to scale platform work and accelerate your teammates - A systems thinker who reasons carefully about freshness, correctness, and failure modes, especially for data that everything else depends on - Pragmatic: you start with the simplest solution that works, prove it, then scale it, and you balance fast answers with durable solutions - You look for where AI can remove a bottleneck for the people and agents who depend on the warehouse, and you build the durable tools and workflows they rely on every day Benefits and Perks (US Only) 💖 At WorkOS, we offer resources that emphasize personal and familial well-being. We offer healthcare coverage for you and your family, including medical, dental, and vision. We offer parental leave, paid-time off and fully remote working arrangements.   - 401k matching - Competitive Equity - Healthcare, dental and vision coverage - FSA, ST/LT Disability, Voluntary Life - Carrot fertility benefits - 20 days paid vacation + 10 holidays + unlimited sick leave - 12 weeks fully paid parental leave - Fitness: Monthly stipend for gyms, yoga classes, race registrations or whatever keeps you active - Wellness: Monthly stipend for a massage, meditations class, therapy, or activities that enhance your well-being - Commuter benefits for hybrid employees in SF/NYC - Unlimited token usage! Please inquire directly with our recruiting team for benefits available to those working outside the US.   Equal Opportunity Employer WorkOS is an equal opportunity employer, committed to diversity and inclusiveness. We will consider all qualified applicants without regard to race, color, nationality, gender, gender identity or expression, sexual orientation, religion, disability or age. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

– Разрабатывать и сопровождать потоковые приложения на Apache Flink: подключать новые домены и типы событий, реализовывать дедупликацию, идемпотентную обработку, обогащение через Redis и маршрутизацию невалидных событий в DLQ; участвовать в восстановлении и дозагрузке данных;

Location: Remote - US Workplace: Remote ABOUT US At LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale. With $125M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we’re at a stage where we’re continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world. Today, our platform includes LangSmith (Observability, Evaluation, Deployment, Fleet, and Sandboxes), our open source frameworks (LangChain, LangGraph, and Deep Agents), and the newly launched LangSmith Engine for autonomous agent improvement. We have 100M+ monthly open source downloads, 6,000+ active LangSmith customers, and 5 of the Fortune 10 use LangSmith in production (+ 35% of the Fortune 500 overall), including teams at Klarna, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, LinkedIn, Monday.com, Nvidia, and Bridgewater. ABOUT THE TEAM: We are a small but mighty team of three analytics engineers powering LangChain’s internal data infrastructure and analytics. We’re a full-stack team, meaning we work end-to-end across the data stack, from data ingestion to enabling self-serve agentic analytics. Learn more about what we’ve built so far here https://www.langchain.com/blog/agent-data-stack! ABOUT THE ROLE: We are expanding our data team and looking for a analytics engineer to join us. We build products used by elite companies and over a million developers, and data plays a critical role in sharping our strategies and decision making. In this role you will help lay the foundation for business teams to diagnose issues, uncover opportunities, and drive success using data. If you enjoy building data infrastructure and empowering teams with actionable insights, this role is for you. *Location: SF, NYC, Boston, or Remote U.S. WHAT YOU WILL DO: - Build scaleable dbt models and context that describe our business, powering a self-serve analytics experience - Work with and expand on our foundational data stack — Fivetran, dbt, BigQuery, Hex - Connect data from a variety of sources (Salesforce, Stripe, Metronome, Postgres, etc) into our BigQuery warehouse - Build dashboards that track progress against company goals and KPIs - Analyze product usage and operational data to surface insights around customer health, adoption, and revenue - Develop and leverage a deep understanding of our business metrics to drive alignment and decision-making WHAT YOU'LL BRING: - 3+ years experience in a related role (analytics engineer, data engineer, or similar) - Technical proficiency in BigQuery, dbt, Hex, Fivetran, Segment (or similar tools) - Detail oriented, enjoys data spelunking, and can synthesize findings effectively - Curiosity and a strong business sense to help anticipate needs and generate meaningful insights - Start up DNA. You thrive in fast-paced and unstructured environments and are energized by finding out what matters most - You are self-directed - you don’t wait for process or oversight to start making an impact Compensation & Benefits: We offer competitive compensation that includes base salary, meaningful equity, and benefits such as health and dental coverage, flexible vacation, a 401(k) plan, and life insurance. Actual compensation will vary based on role, level, and location. For team members in the EU and UK, we provide locally competitive benefits aligned with regional norms and regulations. Annual salary range: $140,000-$180,000 Compensation Philosophy: We offer competitive compensation that includes base salary, variable compensation for relevant roles, meaningful equity, benefits, and perks. We are hiring for this role across a range of scope, and the compensation band reflects that. Your offer depends on what we learn about your impact, craft, leadership, and communication during the interview process. We will tell you early where you’re tracking and talk comp with you before offer stage. Team members in the EU, UK, and APAC receive locally competitive benefits aligned with regional norms and regulations. BENEFITS Benefits include medical, dental, and vision coverage, flexible vacation, a 401(k) plan, meals on in-office days in the US and more.

- Миграция ETL-системы телеком-оператора с Oracle/Informatica на Apache стек (S3, Airflow, NiFi, Kafka, Greenplum); - Перенос бизнес-логики из Informatica в высокопроизводительный SQL-код;

– Разработка, создание и оптимизация масштабируемых ETL-процессов и конвейеров обработки данных. – Разработка и поддержка решений в области бизнес-аналитики, хранилищ данных и аналитических наборов данных.

-Организация пайплайнов потоков данных (конвейера движения данных в компании). -Разработка, поддержка и оптимизация производительности Корпоративного Хранилища Данных (EDWH).

Задачи: — Разрабатывать и поддерживать ETL процедуры в Airflow — Проектировать, реализовывать и внедрять распределённые системы обработки и хранения данных — Участвовать в развитии архитектуры хранилища — Работать с реляционными/NoSQL базами данных — Разрабатывать и поддерживать процедуры автоматизации аналитической инфраструктуры Требования: — Уверенное знание SQL — Уверенное знание Python — Опыт разработки ETL процедур от 3-х лет — Опыт работы с реляционными СУБД — Навыки командной разработки в Git — Будет плюсом опыт работы с современными code-driven ETL/ELT инструментами, распределенными колоночными СУБД (ClickHouse, Vertica, Greenplum), Docker, Kubernetes, S3 хранилищем, CI/CD процедурами Условия: — Официальное трудоустройство и конкурентная заработная плата — Удаленный формат работы с возможностью работать в офисе рядом с метро Дмитровская, Савеловская — Предоставление современной рабочей техники, дополнительного монитора — Гибкое начало рабочего дня по согласованию с руководителем — Медицинское страхование (ДМС со стоматологией), страхование от несчастных случаев и критических заболеваний после испытательного срока — Консультации психолога от сервиса «Ясно» — Поддержка в обмене знаниями и идеями, поощрение выступлений на митапах — Бесплатная подписка на сервис корпоративных скидок и предложений BestBenefits и доступ к онлайн-библиотеке издательства «МИФ»

You’ll take full ownership of the production databases at a high-traffic, high-load startup with millions of rows. Required: PostgreSQL (Crunchy Bridge), MySQL (PlanetScale).

🔍We are looking for a Senior Database Engineer (PostgreSQL, MySQL). You’ll take full ownership of the production databases at a high-traffic, high-load startup with millions of rows.

- Developing and optimizing complex SQL queries and stored procedures. - Designing database schemas for high-load systems.