Sr Data Engineer - General Motors - Detroit, MI
(2014-04)
- Engineered and developed Spark applications utilizing Python to process data and load into Databricks Delta Lake tables, adhering to the medallion architecture (Bronze, Silver, Gold) by streaming data from Kafka and Azure Event Hubs.
- Deployed Spark applications on Kubernetes on-premises and Azure Kubernetes Service (AKS) for cloud-based Spark applications through GitHub Actions CI/CD pipelines.
- Assessed existing on-premises applications and facilitated their migration into Databricks, ensuring continuity for downstream applications and reporting projects.
- Maintained and enhanced on-premises ETL processes utilizing IBM DataStage, SSIS, Oracle, and SQL Server.
- Mentored junior engineers, assisting with project integration and technical challenges.
- Leveraged expertise in IBM DataStage, SSIS, Spark applications, Unix shell scripting, Oracle, SQL Server (including stored procedures), IIDR, GoldenGate, and Power BI for data engineering tasks.
Teradata Developer - Cigna HealthCare - Bloomfield, CT
(2013-07 - 2014-04)
- Executed a Datalab project to migrate data from Oracle to Teradata Warehouse, employing dimensional modeling principles with data organized into facts and dimensions.
- Managed the end-to-end data migration from Oracle to Teradata using Teradata utilities and developed views for business user consumption.
Data engineer - Cigna HealthCare - Hartford, CT
(2013-07 - 2014-04)
Teradata Developer - Bank of America - Charlotte, NC, USA
(2013-03 - 2013-05)
- Developed and maintained the SABER calculator, used for managing the bank's enterprise capital and generating monthly and quarterly capital reports.
- Managed the 'Other Assets' workstream, reconciling balances from Wholesale, Retail, Cash Securities, and Counterparty divisions against INSIGHT balances.
- Executed Quarterly End Reinstatements (QER) by retrieving quarterly production data, running code in the QE environment, and comparing results against production data.
Data Engineer - Bank of America - North Carolina, US
(2012-05 - 2013-05)
Data Engineer - IBM - Charlotte, NC, USA
(2012-05 - 2013-05)
- Initiated the development of a new platform, the Customer Systems Data Integration Platform (CSDIP).
- Replaced multiple legacy mainframe batch processes by adopting data integration tools and methodologies with IBM DataStage and QualityStage 8.5.
Data Migration Specialist - IBM - Bentonville, AR, USA