← к выдаче
разработка

Senior Data Engineer

Warszawa, Kraków, Gdańsk, Wrocławвчера

Описание от работодателя

Required skills: Databricks, PySpark, Python We are looking for a Senior Data Engineer to join our Sustainability Data & AI team and help build and operate a modern Sustainability Data Foundation based on Databricks . You will develop scalable data products and pipelines supporting sustainability reporting, regulatory compliance and analytics , taking ownership from design through production. Workload: Full-time Work model: Remote Business Travels: YES (business trips to Denmark from time to time) Duration: 12 months + option for extension Start Date: 01/27 Your responsibilities: Design and develop data pipelines and data products using Databricks, Delta Lake and PySpark . Build data models and transformation frameworks for large and complex datasets. Develop data quality controls, validation and reconciliation processes . Optimize pipelines for performance, scalability and cost. Implement CI/CD, automated testing and deployment processes . Support data governance, lineage, security and access management. Work closely with Sustainability, Business, Product and Reporting teams. Troubleshoot issues, perform root-cause analysis and ensure reliable production delivery. Develop Databricks-based tools to simplify data access and reporting. Requirements: 5+ years of experience in data engineering and data platforms. Strong production experience with Databricks . Expert knowledge of PySpark, SQL, data modelling and data pipeline design . Experience with CI/CD, Git, automated testing and deployment . Knowledge of data quality, governance, lineage and auditing . Strong troubleshooting and root-cause analysis skills. Ability to take ownership and deliver pragmatic, production-ready solutions. Nice to have: Experience with ESG / sustainability or regulatory reporting . Knowledge of ERP, procurement, finance or supplier data . Experience building Databricks applications, dashboards or user-facing tools .