← к выдаче
разработка

Senior Data Engineer

Adaptiq25 дн. назад

Эта же роль в других локациях (3)

  • —
  • —
  • —

Коротко

Designs and builds a multi-layer lakehouse (bronze/silver/gold) with Iceberg and Delta formats; develops production-grade data pipelines for a high-volume · Needs: Hands-on data engineering experience; expertise in lakehouse architecture and open table formats; strong SQL and pipeline development skills.

Описание от работодателя

Job Title: Senior Data Engineer Who we are: Adaptiq is a technology hub specializing in building, scaling, and supporting R&D teams for high-end, fast-growing product companies in a wide range of industries. About the Product: Our client is a major online gaming operator building a next-generation transactional Player Account Management platform from scratch (greenfield). Operating in a highly regulated, high-volume environment with millions of concurrent users, the platform processes real-time financial transactions requiring sub-second performance, strict data integrity, and ultra-high availability during extreme traffic spikes. You will own the multi-layer lakehouse architecture, CDC streaming pipelines, and data storage design, directly shaping the scalability, reliability, and governance of the core data platform. Key Responsibilities: Design and maintain a multi-layer lakehouse using Iceberg or Delta Lake, including schema evolution and query performance optimization. Build real-time CDC ingestion pipelines with Kafka and Debezium, handling late or duplicate events. Ensure data freshness, quality, and automated reconciliation with source transactional systems. Implement data governance practices, including metadata, lineage, PII protection, and audit trails. Develop production data pipelines using Python, Airflow, or Dagster. Key Requirements: 5+ years of data engineering experience with large-scale data systems, data lakes, or lakehouse environments. Production experience with AWS S3 and analytics platforms such as Snowflake, Databricks, or BigQuery. Hands-on experience with open table formats like Iceberg, Delta, or Hudi. Experience building CDC and streaming data pipelines using Kafka or Debezium. Strong SQL, Python, and data modeling skills for relational and transactional data. Background in financial, transactional, or audit-heavy domains is a plus. What We Offer: 20 paid vacation days plus official national holidays. Full legal and accounting support. Fully remote work model within Poland with a powerful workstation provided or co-working space support.