← к выдаче
разработка

Senior Python Data Engineer

EPAM SystemsWroclaw22 дн. назад

Коротко

Builds and maintains data pipelines and models on Azure using Databricks, Apache Spark, Delta Lake, and Delta Live Tables; owns data engineering solutions in · Needs: Required skills: Python, Databricks, Apache Spark, Azure, Delta Lake, Delta Live Tables, GitLab, SQL

Описание от работодателя

Required skills: Python, Databricks, Apache Spark, Azure, Delta Lake, Delta Live Tables, GitLab, SQL We are seeking a hands-on Senior Python Data Engineer to join the Regulatory Reporting team in Poland within the Investment Bank's Digital Operations Stream, working to transform how the client does business by simplifying and improving the products and platforms relied on by Regulatory and Data Clients. Please note that working from the client's office is required 3 days per week. Responsibilities Design, implement and maintain new and existing data-driven applications Develop and deliver solutions end to end Engineer reliable data pipelines for sourcing, processing, distributing and storing data Design data models that can support ever-growing volumes Contribute to all stages of the software development lifecycle Provide technical expertise, recommendations and innovative solutions Collaborate with the product owner and other technologists Share expertise and best practice with colleagues and contribute regularly to the engineering culture Requirements Hold a Bachelor's degree in Computer Science or equivalent in the IT field with 5+ years of experience in a similar role Background in Big Data, Data warehouse and Data lake Showcase of hands-on experience building scalable data pipelines, processing high volume data in batch and stream for near real-time analytics Expertise in Databricks, Python and Spark Familiarity with Delta Lake, DLT and GitLab Knowledge of Cloud technologies such as Azure, Unix/Linux and shell scripting Expertise designing applications considering NFRs around high throughput and low latency for data processing Expertise building automated functional testing and CI/CD pipelines using industry standard tools Capability to quickly implement prototypes and iterate to harden the product with good engineering principles Hands-on usage of AI in engineering SDLC English proficiency at B2 level or higher Nice to have Proficiency in database development including SQL, PL/SQL, PostgreSQL and Azure SQL We offer We gather like-minded people: Top tech minds driving innovation in AI, cloud and digital platform modernization Supportive team and agile, startup-like culture Hybrid by design mode and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Career development programs Thought leadership, mentoring, soft skills and well-being programs Certification (Anthropic, Gemini, GCP, Azure, AWS) English classes We cover it all: Stable pay Participation in the Employee Stock Purchase Plan with a 15% discount Benefits package (health insurance, multisport, shopping vouchers) Referral bonuses up to $2,000 Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more Corporate, social and well-being events Please, note: Benefits listed above are available to employees only We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually We will reach out to selected candidates exclusively EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.