Aswathaman M

Results driven Data Engineer with experience in designing, implementing, and maintaining scalable and reliable data pipelines on modern cloud platforms. Proven ability to build and maintain Data Warehouses/Data Lakes using Databricks (Lakehouse) and Snowflake, specializing in advanced data modeling and transformation with dbt (Data Build Tool). Proficient in Python, SQL, and data orchestration (Azure Data Factory), with a strong focus on data integrity, CI/CD best practices, and delivering high quality data for analytics and ML use cases.

Data Engineer at E3 – Data Migration & Financial Services Data Modernization | IBM India Pvt Ltd (2025-04 – Present)

Lead data modeling, migration, and modernization initiatives for financial services clients

• Data Modeling & Migration: Architected a metadata-driven ingestion framework to orchestrate automated dbt models for 90+ financial entities, optimizing time-series transformations to improve compute efficiency and reduce cloud costs while ensuring data integrity.
• Semi-Structured Data Processing: Designed complex dbt models to explode and parse high-volume XML and JSON data from NoSQL sources, flattening hierarchical structures into relational tables to enable downstream analytics.
• Data Validation & Integrity: Implemented automated testing frameworks (Databricks Labs) and quality controls on transformed data, ensuring data integrity and compliance for a major financial services client (Nationwide).
• Automation & CI/CD: Orchestrated dbt pipelines using Databricks Workflows and integrated them into CI/CD pipelines for reliable deployment.
• Client Engagement & Requirement Analysis: Led technical discussions with business clients and functional analysts to translate complex business requirements into scalable data models and architectures, ensuring zero ambiguity in integration impacts.

L1 Data Engineer at L1 Data Engineer | IBM India Pvt Ltd (2022-11 – 2025-04)

Designed and optimized data pipelines for Air Canada's operations

• Pipeline Monitoring: Engineered Power BI monitoring dashboards to visualize pipeline performance and latency for Air Canada's PSS and Loyalty systems, enabling proactive resolution of data delays.
• ELT Optimization: Developed and optimized ELT data pipelines (using PySpark/SQL) to ingest and integrate complex operational data from Air Canada's core systems (PSS, Loyalty, Cargo).
• Data Quality: Implemented initial data validation checks and quality controls on ingested datasets to maintain data consistency and accuracy.
• Data Delivery: Worked closely with Data Analysts to deliver clean, high-quality data, ensuring accessibility and timely insights for operational efficiency improvements.

B.E. in Electronics and Communication – Chennai Institute of Technology (2018 – 2022)