Location: Bengaluru, India
We are looking for a Senior Data Engineer to implement and validate change data capture from AWS Aurora PostgreSQL into Snowflake. You will help build metadata driven integration frameworks, support schema adoption in the Medallion architecture, and contribute to performance, reliability, and governance across the data flow.
The Analytics Warehouse project supports a large portfolio of business applications with a centralized data environment. The initial milestone focuses on implementing and validating managed ingestion from Aurora PostgreSQL to Snowflake, with production rollout and full dimensional modeling planned for later phases.
Configure and operate Snowflake OpenFlow from Aurora PostgreSQL to Snowflake
Tune and troubleshoot Aurora PostgreSQL for logical replication
Provision infrastructure using Terraform and AWS IAM with least privilege access controls
Run structured proof of concept tests for large tables high volume CDC concurrency and outage recovery scenarios
Document outcomes of proof of concept testing and validation activities
Monitor replication health using Snowflake native observability and Amazon CloudWatch
Define success criteria with stakeholders for replication and ingestion validation
Support Snowflake side setup for managed ingestion including warehouses grants schedules and reconciliation checks
Apply security and governance practices appropriate to a regulated financial and member services context
Perform schema DBT and Snowflake native pipeline renewal while preserving business and data continuity
Execute performance and cost improvements
Follow agreed teardown procedures to remove replication and access artifacts
Hands on experience with Snowflake OpenFlow or Apache NiFi
Strong experience with PostgreSQL or Aurora including logical replication WAL slots and access control
Experience with Terraform on AWS including networking security groups IAM and role pass through for managed services
Experience with DBT for data transformations
Proficiency in SQL for transformations validation and reconciliation
Working knowledge of Snowflake including warehouses roles and loading patterns
Understanding of CDC and ELT fundamentals
Experience with data quality validation and reconciliation practices
Strong communication skills for Agile cross team collaboration in distributed teams
Experience with GitHub
Experience with PostgreSQL sources and Snowflake targets using OpenFlow NiFi or similar services
Experience with Python or similar languages for checks automation and reporting
Experience with Snowflake OpenFlow or similar managed CDC offerings
Experience with Airflow or equivalent tools for production orchestration
Experience in financial services or similar regulated domains
Experience with cloud cost estimation for replication at scale
Experience with Amazon EKS or Kubernetes for monitoring and issue resolution in the OpenFlow or NiFi environment
Experience with Cursor or Claude
Experience with specification driven development
Зарплаты и спрос: Дата-инженер
Сейчас в каталоге 475 вакансий по этому направлению, удалённо можно работать в 45%.
Зарплата здесь не указана. Медиана по направлению: 245 000 ₽ в месяц. У половины вакансий от 160 000 ₽ до 290 000 ₽ (вакансий с вилкой: 37).
У компании DataArt сейчас 8 вакансий по этому направлению.
УдалённоRemote / Germany; On-site presence is expected to be more frequent during the initial implementation phase and primarily driven by audits and specific business needs thereafter