Lead Engineer - Data Engineering

Hiring: Lead Engineer - Data Engineering

Experience: 5 - 7 Years

Location: Chennai

Primary Skills: SQL, Python, Data Engineering

Role Overview:

Looking for an experienced Data Engineer with strong hands-on expertise in SQL and Python to build and optimize data pipelines, perform data profiling, and support scalable data solutions.

Key Responsibilities:

• Perform data profiling to identify primary keys, data quality issues, cardinality, data types, precision, scale, and data skew.
• Develop and maintain ETL/ELT pipelines for data ingestion and transformation.
• Design and update dimensional data structures and use-case-specific datasets.
• Perform unit, functional, and performance testing.
• Optimize data pipelines and queries for performance.
• Work closely with Product teams to understand and refine requirements.
• Collaborate with QA teams to troubleshoot and resolve data-related issues.
• Work independently and collaboratively to deliver project objectives.
• Take ownership of assigned tasks and proactively contribute to the team.

Must-Have Skills:

• Strong hands-on experience with SQL and Python.
• Advanced SQL knowledge including CTEs, Complex Joins, and Analytical / Window Functions.
• Strong understanding of Data Profiling and Data Quality.
• Ability to identify unique and primary keys and analyze data characteristics.
• Strong ETL/ELT and data transformation experience.
• Good communication and stakeholder collaboration skills.
• Ability to work independently and take ownership.

Good to Have:

• Real-world experience with Snowflake.
• Hands-on experience with dbt.
• Experience in the Healthcare / Payer domain.