Job Title : Azure Data Engineer
Location : Pune
Experience : 6+ Years
Job Summary :
We are seeking a skilled and experienced Azure Data Engineer to design, develop, and optimize scalable data solutions on the Microsoft Azure platform. The ideal candidate should have strong expertise in Azure Databricks, PySpark, Azure Data Factory (ADF), Azure Data Lake Gen2, and Power BI, with a passion for building reliable and efficient data pipelines.
Key Responsibilities :
- Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF).
- Develop and optimize large-scale data processing solutions using Azure Databricks, PySpark, and Apache Spark.
- Manage data storage and ingestion using Azure Data Lake Storage Gen2.
- Build interactive dashboards and reports using Power BI to support business decision-making.
- Collaborate with cross-functional teams to gather requirements and deliver data-driven solutions.
- Ensure data quality, security, governance, and compliance across the data platform.
- Monitor, troubleshoot, and optimize data workflows for performance and reliability.
- Participate in code reviews, testing, and CI/CD implementation for Azure data solutions.
Required Skills:
- Strong experience with Azure Data Factory (ADF).
- Hands-on expertise in Azure Databricks and PySpark.
- Experience with Azure Data Lake Storage Gen2.
- Strong knowledge of Apache Spark for distributed data processing.
- Proficiency in Power BI for reporting and visualization.
- Good understanding of SQL and data modeling concepts.
- Strong analytical, troubleshooting, and problem-solving skills.
Preferred Skills:
- Knowledge of Unity Catalog and Data Governance.
- Experience implementing CI/CD pipelines for Azure Data Factory or Databricks.
- Microsoft DP-203 (Azure Data Engineer Associate) certification.
- Experience working in Agile environments.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field (or equivalent experience).
Sunware Technologies