Senior Data Engineer
Описание от работодателя
Required skills: Databricks, PySpark, Python
We are looking for a Senior Data Engineer to join our Sustainability Data & AI team and help build and operate a modern Sustainability Data Foundation based on Databricks .
You will develop scalable data products and pipelines supporting sustainability reporting, regulatory compliance and analytics , taking ownership from design through production.
Workload: Full-time
Work model: Remote
Business Travels: YES (business trips to Denmark from time to time)
Duration: 12 months + option for extension
Start Date: 01/27
Your responsibilities:
Design and develop data pipelines and data products using Databricks, Delta Lake and PySpark .
Build data models and transformation frameworks for large and complex datasets.
Develop data quality controls, validation and reconciliation processes .
Optimize pipelines for performance, scalability and cost.
Implement CI/CD, automated testing and deployment processes .
Support data governance, lineage, security and access management.
Work closely with Sustainability, Business, Product and Reporting teams.
Troubleshoot issues, perform root-cause analysis and ensure reliable production delivery.
Develop Databricks-based tools to simplify data access and reporting.
Requirements:
5+ years of experience in data engineering and data platforms.
Strong production experience with Databricks .
Expert knowledge of PySpark, SQL, data modelling and data pipeline design .
Experience with CI/CD, Git, automated testing and deployment .
Knowledge of data quality, governance, lineage and auditing .
Strong troubleshooting and root-cause analysis skills.
Ability to take ownership and deliver pragmatic, production-ready solutions.
Nice to have:
Experience with ESG / sustainability or regulatory reporting .
Knowledge of ERP, procurement, finance or supplier data .
Experience building Databricks applications, dashboards or user-facing tools .