IBMIntroduction A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact.
At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.
As a Data Engineer specializing in Data Platforms on Azure, you will advise on, develop, and maintain data engineering solutions on the Azure Cloud ecosystem.
You will design, build, and operate batch and real-time data pipelines using various Azure services.
Your primary responsibilities will include:
Design, develop, and maintain robust data pipelines using DBT as a core transformation framework
Build and optimize data processing workflows using Python, PySpark, and Spark SQL
Develop scalable ETL and ELT solutions for large‑scale datasets
Work with Azure cloud services to manage data storage, compute, and orchestration
Implement data modeling, performance tuning, and pipeline optimization best practices
Collaborate with analytics teams, data scientists, and platform engineers to support enterprise analytics and AI initiatives
Ensure data quality, governance, and reliability across the data ecosystem
Required Technical And Professional Expertise
Strong hands‑on experience in DBT (must have)
Proficiency in Python, PySpark, and Spark SQL
Solid experience in data engineering and big data processing
Experience working with cloud platforms, preferably Azure
Strong understanding of data modeling, performance tuning, and optimization
Proven experience handling and processing large‑scale datasets
5 to 8 years of experience in Data Engineering roles
Prior experience supporting enterprise analytics or AI platforms
Preferred Technical And Professional Experience
Exposure to AI or ML pipelines, including Generative AI workflows
Knowledge of data orchestration tools such as Airflow or Azure Data Factory
Familiarity with CI/CD and DevOps practices for data platforms
Mid-Senior level
Full-time
IT Services and IT Consulting
¿Te interesa este puesto?