Illakiyan G

Results-driven Data Engineer with 5+ years of experience designing, building, and optimizing large-scale ETL/ELT pipelines and cloud data warehousing solutions. Expert in Snowflake, Matillion DPC, Azure Data Factory, Python and SQL, with deep proficiency in dimensional modeling, cloud migration, data quality frameworks, and automated batch processing. Proven track record of delivering measurable improvements in pipeline efficiency, data reliability, and analytical capability for enterprise clients.

Data Engineer at Emergere Computing Solutions (2023-05 – Present)

Project: USLBM – Enterprise Data Warehousing, Pipeline Modernization & Cloud Migration

• Architected scalable ETL/ELT pipelines using Matillion DPC & Python to ingest data from 10+ source systems into Snowflake, reducing data latency by ~40%.
• Led cloud migration of legacy on-premise ETL to Matillion DPC, enabling serverless orchestration and eliminating infrastructure overhead.
• Designed & deployed Matillion DPC components — Custom Connectors, Data Loaders, Orchestration Jobs — cutting build time by ~30%.
• Built parameterized pipeline templates in Matillion DPC, standardizing ingestion across domains and improving dev velocity & governance.
• Designed star and snowflake dimensional models in Snowflake, improving query performance and enabling self-service analytics.
• Implemented Snowflake optimizations — clustering keys, materialized views, warehouse auto-scaling — significantly reducing query times.
• Automated batch processing for multi-million-row datasets; maintained 99%+ pipeline uptime via Matillion DPC log analysis & incident resolution.
• Ensured 100% data integrity via end-to-end validation; migrated legacy FOXpro assets into Snowflake via DPC pipelines.
• Integrated Azure Data Factory with Snowflake for cross-cloud data movement & multi-stage pipeline orchestration via Azure Blob Storage.
• Collaborated with BAs, Data Architects & System Analysts to translate requirements into ETL specs, data flow diagrams and documentation.

Data Engineer at Nallas Corporation (2021-11 – 2023-04)

Project: A-PLUS PROPERTY (Nov 2021 – Nov 2022)

• Developed RESTful APIs using ASP.NET Core MVC 4 & C# connecting Angular JS frontend with PostgreSQL for core property management workflows.
• Designed relational DB schemas, triggers & stored procedures in PostgreSQL to enforce business logic and data consistency.
• Integrated CI/CD via Bamboo & Octopus Deploy; enforced SonarQube quality gates, reducing post-release defects.

Data Engineer at Nallas Corporation (2021-04 – 2021-10)

Project: QEAsaS – Quality Engineering as a Service (Apr 2021 – Oct 2021)

• Built Azure-to-Snowflake data ingestion pipelines for test-bank migration, enabling rapid QA dataset access for analytical reporting.
• Connected Snowflake with Tableau to deliver real-time test execution dashboards for QA leads & PMs.
• Automated Jira Zephyr issue assignment via POSTMAN/SWAGGER orchestration, significantly reducing manual QA effort.

Bachelor of Engineering in Computer Science & Engineering – Karpagam Academy of Higher Education (2016-07 – 2020-09)