Data Engineer with Python

We are seeking an experienced and highly motivated Data Engineer to join our expanding Data Engineering practice. This role will enhance one of our established Platform Teams, where you will design, construct, and scale data pipelines using Databricks with PySpark on Microsoft Azure, enabling our AI Factory teams to create and deploy advanced machine learning solutions. This position offers a unique opportunity to work at the crossroads of big data, cloud frameworks, and MLOps, delivering durable, scalable, and efficient data platforms that promote innovation throughout the organization.

Responsibilities Design analytical solutions using Cloud Native, Big Data, and NoSQL technologies

Build scalable data pipelines with Databricks and PySpark on Azure

Collaborate with MLOps and ML Engineering teams to deliver robust data platforms for AI model development and deployment

Work alongside architects, technical leads, and cross-functional teams to align solutions with business objectives

Assist the SAP Platform Team in utilizing SAP BTP and hyperscaler services for enterprise-grade data platforms

Conduct and participate in code reviews to ensure adherence to technical standards and best practices

Mentor junior engineers to cultivate an innovative and high-performance engineering culture

Implement CI/CD practices into data workflows using tools like Jenkins, GitLab CI/CD, and Concourse

Facilitate communication with stakeholders to understand business processes, model input data, and deliver aligned solutions Requirements Minimum of 2 years' experience in Software Engineering with a solid background in Data Engineering, Machine Learning Operations, or Machine Learning

Expertise in Python and PySpark

Familiarity with Databricks and Microsoft Azure cloud services

Strong knowledge of software version control tools like GitHub or Git

Background in CI/CD tools such as Jenkins, GitLab CI/CD, or Concourse

Proven capability to deliver scalable, robust, and highly available data solutions

Competency in problem-solving, analytical thinking, and managing stakeholder relationships Nice to have Skills in another programming language such as Java, SQL, or Scala

Understanding of SAP BTP or comparable enterprise data platforms

Background in agile development methodologies We offer Opportunity to Engineer your Future and to drive the world’s digital transformation with top industry clients

Personal development program that will allow you to be valued for your strengths

Wide range of professional trainings and workshops

Being part of a collaborative, fast-growing, and innovative design team

Established and accelerated growth toward different career paths, competencies, and roles

Broad projects variety and possible mobility between projects over the time

Collaboration in a multicultural environment and exchange of best practices with colleagues around the world

Varied social benefits, Sports, Transportation and Health programs

Work-life balance and flexible schedule, team buildings and sport opportunities

Modern office/collaboration spaces (incl. new Infinity Tower business center, Sofia)

Hybrid By Design - we provide you with the best productivity options from the 2 worlds. Meet, socialize and enjoy F2F time with your colleagues, while working from the modern EPAM's office for a few days per week and benefit from the EPAM's virtual working environment - making you able to be productive and work from remote for the rest of the week