Big Data Lead
Коротко
Owns data engineering and ETL/ELT development, data pipeline development, and performance optimization using Databricks, Azure Data Factory, SQL, and Python. · Needs: Databricks, Azure Data Factory, SQL, Python; data engineering and ETL or ELT development; data pipeline development and performance optimization.
Описание от работодателя
REQ 38386- Must-Have SkillsDatabricksAzure Data FactorySQLPythonData engineering and ETL or ELT developmentData pipeline development and performance optimizationNice-to-Have SkillsExposure to Generative AI solutions and use cases.Experience working on AI or machine-learning-related data projects.Knowledge of Power BI, including dataset preparation and report integration.Experience with PySpark, Delta Lake, or Azure Data Lake Storage.Familiarity with Microsoft Azure cloud services.Understanding of CI/CD processes for data-engineering solutions.Exposure to data preparation for large language models, embeddings, vector databases, or retrieval-augmented generation solutions.