Azure Data Engineer
Send a job offer directly to this candidate
Azure Platform – Databricks and ADFFMCGAzure Data EngineerWorking as a primary resource for SOR, expertise in designing data wrangling pipelines in Azure data factory. Managed end-to-end flow of project from extracting the transactional files from sources and transform raw data into wrangled fact tables and loaded the data into downstream application for further processing which produces a usable report by users/customers.
Resolved many critical tickets with priority and provide RCA for the issue on time without causing breach to SLA. Also, provided retrospective view on the issue to users in order to avoid such issues in mere future.
Created DQE scripts in Pyspark which validate and encounter the flaws in the transactional files on daily basis through scheduled pipelines. This has greatly stabilized the system and reduced the number of critical tickets by 90%.
Guided Junior minds by providing Knowledge transfer sessions on the project and mentored to resolve the tickets and worked on re-analyzing the data if there are any back dated visits to specified stores.
Validating the datasets and sending UAT signoff and release ADF pipelines in production.
BE-ECE,Affiliated College of Anna university,2020
