Senior ETL Developer (f/m/x)
Коротко
Designs, develops, maintains high-performance financial market data platform for FX; processes up to 40M messages daily; ETL processes; PostgreSQL and Python · Needs: 5+ years PostgreSQL; strong SQL and data modeling; PL/pgSQL mastery; performance tuning; ETL with large data volumes; Linux; advanced Polish and English
Описание от работодателя
Required skills: PostgreSQL, Python, SQL, PL/SQL, Apache Kafka, RabbitMQ
We are looking for an experienced Senior ETL Developer to join our team building a financial market data platform. You will be responsible for designing, developing, and maintaining high-performance data platforms that support analysis processes for FX. Working with large volumes of data, you will process up to 40 million messages daily in a real-time architecture based on PostgreSQL and Python. This position offers you the opportunity to contribute to an enterprise-class platform that handles numerous currency pairs and ensures high availability and scalability of solutions. If you are passionate about data engineering and optimizing data workflows, this opportunity may be the right fit for you.
Your tasks
Designing and developing high-performance data platforms using PostgreSQL and Python
Maintaining and optimizing database performance for large data volumes
Implementing ETL processes to ensure efficient data integration and transformation
Collaborating with cross-functional teams to support real-time data access and processing
Monitoring system performance and implementing necessary adjustments for scalability
Creating and managing database models, including normalization and denormalization
Utilizing PL/pgSQL for writing procedures, functions, and triggers
Ensuring data integrity and implementing archiving strategies for data retention
Requirements
Minimum 5 years of experience working with PostgreSQL
Strong command of SQL and data modeling techniques
Hands-on mastery of PL/pgSQL, including procedures and triggers
Practical experience with database performance tuning and optimization
Experience in ETL integration and working with large data volumes
Familiarity with the Linux environment
Advanced level of Polish and English
Residency in Poland
Nice-to-have requirements
Experience with Apache Kafka or RabbitMQ
Knowledge of Apache Airflow and CI/CD practices
Background in the banking or financial sector