← к выдаче
разработка

Senior ETL Developer (f/m/x)

SiiPoznań18 дн. назад

Коротко

Designs, develops, maintains high-performance financial market data platform for FX; processes up to 40M messages daily; ETL processes; PostgreSQL and Python · Needs: 5+ years PostgreSQL; strong SQL and data modeling; PL/pgSQL mastery; performance tuning; ETL with large data volumes; Linux; advanced Polish and English

Описание от работодателя

Required skills: PostgreSQL, Python, SQL, PL/SQL, Apache Kafka, RabbitMQ We are looking for an experienced Senior ETL Developer to join our team building a financial market data platform. You will be responsible for designing, developing, and maintaining high-performance data platforms that support analysis processes for FX. Working with large volumes of data, you will process up to 40 million messages daily in a real-time architecture based on PostgreSQL and Python. This position offers you the opportunity to contribute to an enterprise-class platform that handles numerous currency pairs and ensures high availability and scalability of solutions. If you are passionate about data engineering and optimizing data workflows, this opportunity may be the right fit for you. Your tasks Designing and developing high-performance data platforms using PostgreSQL and Python Maintaining and optimizing database performance for large data volumes Implementing ETL processes to ensure efficient data integration and transformation Collaborating with cross-functional teams to support real-time data access and processing Monitoring system performance and implementing necessary adjustments for scalability Creating and managing database models, including normalization and denormalization Utilizing PL/pgSQL for writing procedures, functions, and triggers Ensuring data integrity and implementing archiving strategies for data retention Requirements Minimum 5 years of experience working with PostgreSQL Strong command of SQL and data modeling techniques Hands-on mastery of PL/pgSQL, including procedures and triggers Practical experience with database performance tuning and optimization Experience in ETL integration and working with large data volumes Familiarity with the Linux environment Advanced level of Polish and English Residency in Poland Nice-to-have requirements Experience with Apache Kafka or RabbitMQ Knowledge of Apache Airflow and CI/CD practices Background in the banking or financial sector