Kugan G

Azure Data Engineer with 2.8+ years of experience in designing, developing, and supporting cloud-based data engineering solutions using Azure Data Factory, Azure Databricks, PySpark, ADLS Gen2, SQL, Delta Lake, and Unity Catalog. Hands-on experience building ETL/ELT pipelines, incremental data ingestion, data transformation, validation, and Medallion Architecture. Skilled in SQL development, Spark-based processing, data quality, troubleshooting, and developing reliable data pipelines for analytics workloads.

Azure Data Engineer at optimist technologies pvt ltd (2024-11 – Present)

• Develop and support ETL/ELT pipelines using Azure Data Factory, Databricks, PySpark, ADLS Gen2 and SQL.
• Implement incremental/watermark-based data ingestion and ADF pipeline orchestration.
• Develop PySpark transformations for cleansing, validation, deduplication, schema and datatype standardization.
• Work with Bronze-Silver-Gold architecture, Delta Lake and Unity Catalog for governed data processing.
• Perform SQL-based validation, troubleshooting and data-quality checks across source and target datasets.
• Support pipeline monitoring, issue resolution, Git-based development and Agile delivery.

Data Engineer at Allied Worldwide (2024-03 – 2024-11)

• Developed and supported ETL pipelines using Databricks, Azure Data Lake and SQL to extract, transform, and load data from multiple source systems into cloud storage.
• Performed data transformation, validation, reconciliation and quality checks.
• Supported data migration and ETL optimization activities.
• Collaborated with senior engineers and business teams on data engineering requirements.

Bachelor of Mechanical Engineering in Mechanical Engineering – Sreenivasa Institute of Technology and Management Studies (2018 – 2022)