← к выдаче
разработка

Data Engineer

JustMarkets Tech2 дн. назад

Эта же роль в других локациях (2)

  • —
  • —

Коротко

Develops and supports data infrastructure; creates scalable pipelines; integrates external data sources; shapes data architecture · Needs: 3+ years commercial Data Engineering; DWH architecture; Python; PySpark/Spark/Pandas or scraping/APIs; SQL with PostgreSQL/MySQL; column-oriented DBs

Описание от работодателя

We are seeking an experienced Data Engineer to develop and support reliable data infrastructure across our systems. In this role, you will create scalable data pipelines, maintain data accuracy and consistency, and connect external data sources. Your main goal will be to ensure smooth data movement and strengthen analytics capabilities throughout the organization. You will also help shape our data architecture, apply engineering best practices, and work closely with cross-functional teams to transform raw data into meaningful, actionable insights. Requirements 3+ years of commercial experience in Data Engineering Experience gathering business requirements and communicating with stakeholders Strong knowledge of Data Warehouse (DWH) architecture and principles Hands-on experience designing data warehouses and building ETL pipelines Deep practical experience with Python Hands-on experience in one or more of the following areas: data processing using PySpark, Apache Spark, Pandas, or similar frameworks; data scraping; integration of third-party data sources and APIs Proficiency in SQL and relational databases such as PostgreSQL and MySQL Hands-on experience with column-oriented databases such ClickHouse, Snowflake, Cassandra, BigQuery (many tables with millions of records and above each) Solid understanding of software design patterns, algorithms, and data structures Intermediate English proficiency Will be a plus Experience with messaging platforms such as RabbitMQ or Kafka Familiarity with DataOps practices and data pipeline automation Familiarity with CI/CD pipelines and Kubernetes environments Background in FinTech or Trading domains Responsibilities Communicate with technical and non-technical stakeholders to gather and clarify business requirements Review and analyze data and business logic to ensure consistency, accuracy, and reliability Design, implement, and maintain data pipelines for efficient and scalable data processing Integrate, maintain, and support data solutions and third-party data sources Research and evaluate third-party tools, services, and components for potential use Follow engineering best practices, including code reviews, testing, refactoring, and continuous delivery Design, optimize, and maintain data storage solutions What we offer: Tax expenses coverage for private entrepreneurs in Ukraine Expert support and guidance for Ukrainian private entrepreneurs 20 paid vacation days per year 10 paid sick leave days per year Public holidays as per the company’s approved Public holiday list Medical insurance Opportunity to work remotely Professional education budget Language learning budget Wellness budget (gym membership, sports gear and related expenses)