← к выдаче
разработка

Data Engineer

17 дн. назад

Коротко

Builds and optimizes batch and incremental ETL/ELT pipelines, designs medallion data layers with CDC and SCD, monitors production pipelines, and delivers · Needs: Degree in Computer Science, IT, Big Data or related; 1-2+ years on big data or cloud platforms; Python or Java; strong SQL; Git.

Описание от работодателя

We're looking for a Data Engineer to build and optimize scalable data pipelines and cloud data platforms that power real-time analytics and decision-making. If you're passionate about modern data engineering, we'd love to hear from you. What You'll Do Build and optimize batch and incremental ETL/ELT pipelines Design medallion (bronze/silver/gold) data layers with CDC and SCD Monitor and troubleshoot production pipelines, and cut compute and storage costs Deliver high-quality, well-modeled datasets for analytics and data science teams Document your work, review code and collaborate in an Agile team Candidate Profile Degree in Computer Science, IT, Big Data or a related field 1–2+ years on big data, on-prem or cloud data platforms Snowflake (preferred), Hadoop (HDFS) or AWS (S3) Python or Java; PySpark, Spark SQL or Snowpark Strong SQL (MySQL, SQL Server or Oracle) Airflow (preferred), Oozie or Informatica; Git