Lead Data Engineer

Job Title : Lead Data Engineer

Experience : 8 - 12 Years

Location : Hyderabad, Telangana, India

Industry : IT Services &

• Consulting

Role Overview :

We are hiring a Lead Data Engineer to design, develop, and optimize scalable cloud data platforms and modern ETL/ELT pipelines using Microsoft Fabric, Databricks, or Snowflake. In this role, you will lead the architecture, construction, and maintenance of data lakehouse and data warehouse solutions, build high-performance data pipelines, enable business analytics, and establish data engineering best practices.

Key Responsibilities :

Architecture &

• Pipeline Design :
• Design, build, and optimize scalable batch and real-time ETL/ELT pipelines, data models, and lakehouse/data warehouse architectures using Microsoft Fabric, Databricks, or Snowflake.

High-Performance Data Processing :

• Develop robust data processing, cleansing, and transformation solutions using PySpark, Python, Scala, and SQL for large and complex datasets.

Analytics &

• Visualization Support :
• Support business intelligence and self-service analytics by enabling robust data models for Power BI and other visualization tools.

Technical Leadership &

• Governance :
• Establish coding standards, reusable frameworks, and data engineering best practices while conducting code reviews and driving CI/CD practices.

Quality &

• Reliability :
• Implement data quality, governance, security, access control, and monitoring while resolving complex production and performance bottlenecks.

Required Qualifications &

Skills :

Education &

Experience :

• Bachelor's/Master's degree in Computer Science, IT, Engineering, or a related field with 6 - 10 years of core data engineering experience.

Primary Platforms (at least one) :

• Microsoft Fabric : Data Factory, Lakehouse, Data Warehouse
• Databricks : Spark, Delta Lake, PySpark, MLflow
• Snowflake : Data Warehousing, Snowpipe, Performance Optimization
• Power BI : Data Modeling, DAX, Report Development

Core Technical Expertise :

• Exceptional skills in SQL, Python/Scala, PySpark/Apache Spark, and cloud data services (Azure, AWS, or GCP).

Engineering Standards :

• Deep expertise in data modeling, ETL/ELT concepts, CI/CD, Git, and DevOps workflows.