Data Engineer - Python/SQL/ETL

Role Overview :

We are looking for an experienced Data Engineer to design, develop, and maintain scalable data platforms and enterprise data pipelines in cloud environments.

Key Responsibilities :

• Design and develop scalable ETL/ELT data pipelines.
• Build and optimize data solutions using Python, SQL, Spark, and Databricks.
• Develop data workflows using Azure Data Factory, Azure Synapse, and Databricks.
• Integrate data from multiple enterprise applications and operational systems.
• Implement data models, data quality, governance, and metadata management.
• Work with both batch and near real-time data processing architectures.
• Optimize data pipelines for performance, reliability, and scalability.
• Collaborate with data scientists, analysts, application teams, and business stakeholders.

Required Skills :

• 5+ years of experience in Data Engineering and large-scale data platforms.
• Strong hands-on experience with Python, SQL, Spark, and Databricks.
• Strong knowledge of ETL/ELT and distributed data processing.
• Experience with Azure Data Factory, Synapse, or equivalent cloud data services.
• Good understanding of data modeling, data governance, data quality, and metadata.
• Experience working with cloud data platforms and data storage ecosystems.
• Knowledge of batch and real-time data architectures.
• Exposure to GitHub/Git-based version control and CI/CD is preferred.

Preferred :

• Experience with Azure Kubernetes Service (AKS).
• Experience integrating AI/ML workloads with enterprise data platforms.
• Strong problem-solving and communication skills.