Irfan mastan Mohammed

Data Engineer - Bank of America - Remote, USA

(2025-03)

Developed and maintained cloud-based ETL pipelines using AWS services including Lambda, S3, API Gateway, and Snowflake to ingest and process data from 40+ source systems, improving data availability for reporting.
Built Python and dbt transformation workflows orchestrated with Apache Airflow to prepare analytics-ready datasets, reducing manual data preparation effort by approximately 25%.
Supported the migration of legacy datasets to Snowflake by validating data quality, optimizing SQL transformations, and assisting with production deployments across development and QA environments.
Developed Power BI dashboards to monitor pipeline health, data freshness, and business KPIs, helping operations teams identify issues more quickly.
Contributed to an internal Azure OpenAI chatbot by integrating REST APIs with Azure Functions and Azure Storage, improving access to operational documentation and reducing repetitive support requests.
Worked with data analysts and business stakeholders to resolve data quality issues through validation checks, documentation updates, and root cause analysis, improving reporting consistency.

Data Engineer - Accenture - India

(2022-02 - 2023-06)

Developed and maintained Azure Synapse data pipelines supporting finance and operational reporting, resolving production issues and improving pipeline stability.
Assisted in migrating selected Synapse workloads to Azure Databricks by converting SQL transformations into PySpark notebooks and validating output consistency.
Optimized Delta Lake tables through partitioning and file maintenance techniques, improving query execution time by approximately 30%.
Created metadata documentation, source-to-target mappings, and data dictionaries to improve data governance and onboarding for development teams.
Implemented monitoring and alerting using Azure Monitor and Log Analytics to proactively identify pipeline failures and reduce incident response time.
Participated in Agile ceremonies including sprint planning, backlog refinement, and code reviews while collaborating with QA, business analysts, and senior engineers.

Data Engineer - Cognizant - India

(2020-03 - 2022-01)

Developed ETL pipelines using Azure Data Factory and Databricks to ingest, transform, and load structured data into Delta Lake following Medallion Architecture principles.
Converted legacy SQL transformations into PySpark notebooks while performing unit testing and data validation to ensure successful migration.
Optimized Spark jobs using partitioning, caching, and efficient joins, improving pipeline execution time by approximately 25%.
Supported CI/CD deployments, pipeline monitoring, and production support activities, resolving data issues and ensuring timely delivery of business reports.

About