← к выдаче
разработка

Data Engineer

WTW (Willis Towers Watson)London6 дн. назад

Коротко

Designs and optimizes data pipelines using Microsoft Fabric, Azure Synapse, and Azure Data Factory; develops PySpark notebooks and integrates AI/LLM models and · Needs: Hands-on Data Engineer experience; Microsoft Fabric; Azure Synapse; Azure Data Factory; PySpark.

Описание от работодателя

Are you passionate about solving complex data challenges and building innovative data solutions, especially with cutting-edge tools like Microsoft Fabric, Azure, Google, AWS? Do you thrive on logical problem-solving and are energized by using technology to drive impactful results? If you have hands-on experience as a Data Engineer and are eager to work with Copilot agents and AI tools, we want to hear from you. We’re searching for a Data Engineer with practical expertise in designing, optimizing, and maintaining data pipelines and storage within Microsoft Fabric, Azure Synapse, Azure Data Factory, and Azure Fabric. Experience with Azure, Google, or AWS data tools is valuable, but a willingness to learn and a hunger for growth are just as important. If you enjoy a fast-paced, collaborative environment where your contributions directly impact business outcomes this role could be your next career leap. The Role: Designing, building, and optimizing data pipelines using Microsoft Fabric, Azure Synapse, Azure Data Factory, and Azure Fabric. Developing and fine-tuning PySpark notebooks to efficiently manage large-scale data workloads. Implementing, troubleshooting, and enhancing ETL/ELT workflows in Azure Synapse and Microsoft Fabric. Managing and organizing Data Lakes for seamless data access and high performance. Integrating AI/LLM models, Copilot agents, Power Automate flows, and wider Power Platform solutions into data pipelines and business processes to boost innovation and deliver actionable insights. Supporting the testing and validation of AI-enabled solutions, including Copilot agents and AI/LLM outputs, by checking results, documenting issues, and escalating risks where needed. Building and supporting automation workflows using Power Automate, Power Apps, and related Power Platform capabilities to streamline operational processes and improve data capture. Collaborating with Business team, Data Experts, AI Engineers, Data Analysts, and business domain experts to create powerful, data-driven solutions. Participating in and supporting data security, governance, and compliance initiatives within the Azure and Microsoft Fabric ecosystem. Gathering, integrating, and transforming data from multiple sources, including REST APIs and other application interfaces, while handling large data volumes reliably. Continuing to build knowledge of cloud platforms, AI, and modern data engineering practices through hands-on work, mentoring, and self-learning.