Team Lead Data Consultant
Коротко
Leads data platform design and engineering for investment banking transformation; builds batch and streaming pipelines, Databricks solutions, and CI/CD · Needs: Experience leading data engineering teams; Databricks expertise; CI/CD implementation; financial services domain knowledge.
Описание от работодателя
We are GFT Poland WE KNOW how to tackle complex issues with innovative approach to deliver the highest value. Our reputation has been built around one simple rule: we do not overpromise, WE DELIVER . We deliver to our employees, clients and partners. WE GROW as you grow, so investing in you is our business strategy. Caring for each other is our priority. WE CARE who you are, what you need, how you feel. WE CARE to smile, have fun and develop as human beings.
Why Choose GFT? A culture of top performance
Deep tech IT engineering & consulting
1200 skilled & top-class experts
77% of the team are regular/senior
Products that contribute to a sustainable world
Competitive salary and benefits
Ambitious projects, trainings and tools you need to flourish
Google Cloud Partner of the Year - for going above and beyond for customers
What will you do?
Join a large-scale financial services transformation program focused on investment banking operations. You will be responsible for designing and building modern data platforms, driving data engineering best practices, leading technical initiatives, and delivering scalable solutions for batch and near real-time analytics in a highly regulated environment.
Daily tasks:
- Design and develop scalable data platforms and data processing solutions
- Build and optimize batch and streaming data pipelines for high-volume data processing
- Lead technical design activities with a focus on performance, scalability, and reliability
- Develop and maintain Databricks-based data solutions
- Implement CI/CD pipelines and engineering automation practices
- Drive adoption of AI-powered engineering practices across the software development lifecycle
- Collaborate with cross-functional teams to deliver business-critical data products
- Create prototypes and evolve them into production-ready solutions
- Ensure compliance with non-functional requirements including high throughput and low latency
- Support application modernization and data integration initiatives
- Mentor engineers and promote engineering best practices
- Participate in knowledge transfer and handover activities
Master's degree in Computer Science or a related IT field
12+ years of experience in a similar role
Excellent leadership and team collaboration skills
Hands-on experience using AI in the software development lifecycle
5+ years of experience with Databricks
Strong expertise in Python
Strong expertise in Apache Spark
Experience with Delta Lake and Delta Live Tables (DLT)
Experience with GitLab
Experience with Big Data solutions
Experience with Data Warehouse and Data Lake architectures
Hands-on experience building scalable batch and streaming data pipelines
Experience processing high-volume data for near real-time analytics
Strong cloud experience, preferably Azure
Experience with Unix/Linux environments
Shell scripting skills
Experience designing high-performance applications with strict non-functional requirements
Experience building automated testing frameworks and CI/CD pipelines
Ability to rapidly prototype and harden solutions using sound engineering principles
Nice to have
Experience with SQL
Experience with PL/SQL
Experience with PostgreSQL
Experience with Azure SQL
Experience in investment banking or financial services
Experience with application modernization initiatives
Must have: Degree, AI, Delta Live Table, Big data, Data warehouse, Data Lake, Cloud
Nice to have: Unix, Linux, Automated testing, CD pipelines, Azure