Senior Data Engineer - Snowflake & Airflow
Описание от работодателя
We are looking for a hands-on Senior Data Engineer to design, build, and maintain modern data platforms and production data pipelines using Snowflake, Apache Airflow, Python, and AWS. You will work across the full data engineering lifecycle — from data ingestion and modeling to transformation, testing, deployment, monitoring, and production support. You’ll collaborate with cross-functional teams to turn complex data requirements into reliable, scalable, and well-governed data solutions.
Location: Quantori is an international team: we have colleagues who work not only from office but also remotely from all over the world.
Responsibilities: Design, develop, and maintain production data pipelines using Python, Apache Airflow, Snowflake, and Amazon S3
Design and evolve scalable data architectures, including Bronze, Silver, and Gold data layers
Develop data models and implement incremental loading, historization, versioning, and reusable transformation patterns
Write and optimize complex SQL transformations, views, stored procedures, dynamic tables, streams, tasks, and scheduled jobs
Integrate data from relational databases, APIs, object storage, and file-based sources
Implement data-quality checks, validation, reconciliation, lineage, monitoring, and robust error-handling processes
Manage Snowflake access controls, roles, permissions, service accounts, and deployment across development, staging, and production environments
Maintain CI/CD pipelines for Snowflake objects, Airflow DAGs, and Python code using Git and automated testing
Monitor and troubleshoot production pipelines and proactively improve reliability and performance
Collaborate with data, analytics, engineering, and other technical teams to translate business and technical requirements into reliable data products
Create technical documentation and specifications following established quality and compliance standards
What we expect: 5+ years of experience in Data Engineering, including at least 3 years working with production data platforms
Strong hands-on experience with Snowflake, including Data modeling, RBAC and access management, Warehouse management, Query profiling and performance optimization, Stored procedures
Advanced SQL skills, including complex joins, CTEs, window functions, incremental processing, and query optimization
Strong Python skills for ETL, database integration, automation, error handling, and testing
Production experience with Apache Airflow, including DAG development, dependencies, sensors, task groups, retries, backfills, and operational support
Experience working with relational databases, object storage, APIs, and file-based data sources
Strong understanding of modern data architectures, including medallion and dimensional modeling, slowly changing dimensions, natural and surrogate keys, and historization
Experience with Git, pull requests, automated testing, and CI/CD for data pipelines and database code
Strong problem-solving skills and the ability to work independently in a production environment
Snowflake and Apache Airflow are core requirements for this role; experience only with alternative data warehouses or orchestration tools would not be sufficient
Nice to have: Experience working in regulated or validated environments
Background in life sciences, healthcare, clinical, laboratory, genomic, or bioinformatics data
Experience working with LIMS or other scientific/clinical data systems
Familiarity with OMOP or other standardized clinical data models
Experience with data-consumption and visualization tools such as Tableau or Streamlit
Familiarity with scientific or computational workflows and tools such as Nextflow or similar workflow orchestration platforms
SnowPro certification
Experience with AWS Managed Workflows for Apache Airflow (MWAA)
We offer: Competitive compensation
Remote work
Flexible working hours
A team with excellent tech expertise