← к выдаче
разработка

Data Engineer

Компания скрыта · из аутсорсингавидна после отклика или в ProAndorraсегодня

Название откроется после отклика или сразу в Pro

Описание от работодателя

We are looking for a talented Data Engineer to help shape the next generation of AI-driven financial crime detection solutions. If you have strong data engineering expertise, hands-on experience building and optimizing large-scale data pipelines, and a passion for solving complex real-world challenges, this could be the perfect opportunity for you. In this role, you will design and develop the data foundations that power advanced money laundering detection solutions for leading financial institutions worldwide. Responsibilities Develop, implement, and maintain production-grade data pipelines based on data science requirements. Design and build scalable data flows for specific business use cases that can be integrated into the product. Build and maintain machine learning data pipelines. Create tools and frameworks that support data scientists and analytics teams in developing and optimizing innovative solutions. Collaborate closely with Product, R&D, Data, and Analytics teams to enhance system functionality and performance. Train customer data scientists and engineers on maintaining and enhancing data pipelines within the platform. Travel domestically and internationally to support customers when required. Build and manage strong technical relationships with customers and partners. Requirements 2+ years of hands-on experience with Apache Spark (required). Strong experience with SQL . Experience using version control systems, particularly Git . Hands-on experience with the Apache Hadoop ecosystem , including Hive, Impala, Hue, HDFS, and Sqoop. Experience with Python (Pandas) . Experience with PySpark, Scala, Java, or R . Proven experience in data transformation, validation, cleansing, and machine learning feature engineering. Bachelor's degree or higher in Computer Science, Statistics, Informatics, Information Systems, Engineering, or another quantitative field. Experience working with and optimizing large-scale data pipelines, architectures, and datasets. Strong analytical skills and experience working with structured and semi-structured data. Experience building processes that support data transformation, metadata management, dependency management, and workload optimization. Ability to perform root cause analysis on data and processes to answer business questions and identify improvement opportunities. Strong customer-facing and cross-functional collaboration skills. Fluent in English and Spanish , both written and spoken. Nice to Have Experience working with Linux . Experience building machine learning pipelines . Knowledge of Elasticsearch . Experience with Zeppelin and/or Jupyter . Familiarity with workflow orchestration tools such as Jenkins or Apache Airflow . Experience with microservices and containerization technologies, including Docker and Kubernetes . Why Join Us? You’ll work with a talented global team, contribute to meaningful technical initiatives, and help shape a high performing DevOps culture. Matrix is a global, dynamic, and fast growing technology services and consulting company with over 17,000 employees worldwide. Founded in 2001, Matrix has grown through significant organic expansion and strategic acquisitions, executing some of the largest and most impactful technology projects in the market. We specialize in the design, development, and implementation of advanced technologies, software solutions, and digital products. Our services include infrastructure and consulting, IT outsourcing and offshore delivery, training and assimilation programs, and acting as a trusted implementation and delivery partner for the world’s leading software vendors. With deep expertise across both the private and public sectors—spanning Finance, Telecom, Healthcare, Hi Tech, Education, Defense, and Security—Matrix serves a strong customer base in Israel alongside a continuously expanding global client portfolio. At Matrix, our people are at the heart of our success. We are a community of talented, creative, and dedicated professionals who are passionate about innovation and excellence. We actively attract, develop, and retain top talent, recognizing that every employee’s contribution is critical to our continued growth and future success. Matrix’s success is built on a challenging and engaging work environment, competitive compensation and benefits, and meaningful career development opportunities. We foster a diverse, inclusive culture that encourages collaboration, continuous learning, and growth—together. Join the winning team. Be challenged, grow your career, and enjoy the journey in a highly respected global organization. To learn more, visit: www.[компания].com