Data Engineer
Send a job offer directly to this candidate
Dynamic Azure Data Engineer with 2+ years of experience in designing scalable data pipelines, optimizing ETL workflows, and securing sensitive data. Successfully reduced ETL processing times by 30% and minimized operational costs through cloud migration projects. Proficient in SQL, Python, and Azure tools to drive business insights and efficiency. Aspiring to achieve advanced Azure certifications to further enhance cloud data engineering expertise.
o Designed and developed scalable data pipelines using Azure Data Factory (ADF) to automate ETL processes for ingesting and transforming data from diverse sources such as REST APIs, flat files, SQL databases, and Azure storage.
o Migrated SSIS Loaders to Azure Data Factory, Logic Apps, and Azure Functions, improving data processing efficiency by streamlining workflows and reducing operational costs by leveraging scalable cloud-based solutions.
o Migrated on-premises SQL databases to Azure, reducing operational costs by 15% and improving data accessibility by 20%.
o Played a key role in migrating Power BI report server from on-premises to Azure using Terraform, ensuring seamless integration and operational continuity.
o Designed and implemented Continuous Integration/Continuous Deployment (CI/CD) pipelines using Azure DevOps, enabling automated build, test, and deployment processes to enhance development efficiency and reduce deployment errors.
o Implemented data transformations to support business reporting and analytics, leveraging notebooks and stored procedures, with a focus on performance tuning and version control.
o Applied robust data security measures, including row-level and column-level security, to protect sensitive data.
o Monitored platform performance and provided optimization recommendations to ensure reliability and cost-efficiency.
St. Xavier’s Catholic College of Engineering,