Описание вакансии
Responsibilities:
- Own the company data platform end to end: the S3/Athena/Glue lake, the dbt project and its daily build, ingestion from Stripe, Auth0, HubSpot, OpenTelemetry and product events, and the Postgres serving layer for dashboards and AI agents
- Build and operate integrations between billing, CRM, ERP, identity and telemetry systems so revenue, usage, cost and customer identity reconcile automatically instead of through spreadsheets and tickets
- Design and maintain the warehouse layer: dimensional models, data contracts with product engineering for event schemas, quality tests, lineage and a catalog
- Enforce PII tiering (open vs. restricted schemas) through access grants, working with Security and Legal
- Process data at scale: billions of telemetry rows, terabyte log streams, Iceberg tables, partitioning and cost control
- Own orchestration and infrastructure: orchestration on EKS, Helm, Terraform, CI/CD, monitoring and alerting, and join the business-hours on-call rotation for the daily pipelines
- Deliver operational reporting for Finance and leadership: revenue by business line, credits and prepaid liability, and cloud cost by department
- Support the research teams across every modality: source, license-check, ingest and version large training datasets for audio, video, image and 3D
- Build the generation, filtering, deduplication and captioning pipelines that turn raw or synthetic media into training-ready shards, and run them at scale on our SLURM cluster and cloud object storage
- Keep lineage, quality metrics and dataset documentation current so any researcher can reproduce a training set
- Lead design reviews, mentor teammates and write the runbooks that remove single-person dependencies
- Partner with Finance, Marketing, SRE, Security, Product and Research on company-wide data initiatives
Requirements:
- 6+ years building and running production data platforms, including ownership of the architecture
- Experience integrating SaaS business systems (Stripe, HubSpot, an ERP, an identity provider) into a warehouse
- Production experience preparing large multimodal training datasets and running batch workloads on HPC or cloud schedulers (SLURM, Kubernetes or similar)
- Comfort working independently in a small team with real ownership
- Expert SQL and Python, with strong software engineering habits: tests, code review and CI
- Warehouse and lake experience with real modelling: Iceberg or Delta on S3, Athena/Trino, Snowflake or BigQuery, and dbt
- An orchestrator in production (dbt, Airflow or Argo) and distributed processing (Spark or equivalent)
- AWS, Kubernetes (EKS), Helm and Terraform — you can debug a failing Glue job and a broken Helm release
Additional Strengths:
- Prior 0-to-1 platform ownership at a startup
- Experience working with research teams on generative models, or hands-on exposure to audio, video, image or 3D data
- FinOps and cloud cost reporting
- Familiarity with SOC 2 or similar compliance requirements for data access
Benefits:
- Compensation and benefits are set for each country’s market and local practice
- Health coverage for you and your family
- Choose from PPO and HMO plans, including select plans where Stability AI covers 100% of premiums for you and your eligible dependents
- HSA and FSA accounts to set aside pre-tax dollars for healthcare and other eligible expenses
- Company-paid life insurance, with the option to add voluntary coverage for yourself, your spouse, and your children
- Short- and long-term disability coverage
- 401(k) with company match of up to 4%
- Paid parental leave
- Flexible paid time off, plus paid company holidays
- Equipment provided to do your best work
- Annual base salary range $175,500 - $230,000 USD for candidates hired within the United States
- Equity program participation
The role is remote-first with teammates across multiple countries.