
Akash Behera
Data Engineer
Hire this person
Send a job offer directly to this candidate
About
Data Engineer with 3.5+ years of experience designing and implementing scalable data solutions using Azure and Big Data technologies. Proven expertise in building 100+ end-to-end ETL pipelines with Azure Data Factory and Databricks, enabling automated ingestion and transformation of large datasets. Proven experience of turning complex data into actionable insights to support business decision making.
Experience
Programmer Analyst - Data Engineer at Cognizant Technology Solutions (2024-06 – Present)
- Designed and maintained scalable data models using Azure Data Factory and Azure Databricks, delivering 100+ production grade ETL pipelines.
- Ingested 100,000+ records per day from diverse formats of datasets like Parquet, Delta, CSV into Azure Data Lake Storage Gen2 via Azure Data Factory (ADF) pipelines.
- Automated data ingestion workflows with Azure Data Factory pipelines, reducing manual intervention by 30%.
- Processed and transformed 500+ GB of data from SFTP to ADLS and optimized PySpark jobs in Azure Databricks for improved scalability and performance.
- Designed and implemented CI/CD pipelines using Azure DevOps for automated deployment of Azure Data Factory pipelines and Databricks notebooks across Dev, QA, and Prod environments.
- Managed source control using Azure DevOps Repos (Git), enabling versioning, branching, and controlled production releases.
- Utilized Jira for sprint planning, backlog grooming, and defect tracking, managing 20+ user stories and 10+ defect tickets per sprint in Agile Scrum environment.
Operations Executive - Data Engineer at Infosys Limited (2019-10 – 2021-09)
- Configured Azure Data Lake for big data processing, allowing for smooth conduct of monthly check runs for 2 front-end applications using Azure Data Factory for orchestration.
- Extracted, transformed, and analysed healthcare datasets using PySpark and Spark SQL.
- Monitored daily batches of 600+ production data pipelines to maintain uptime for FISC Online application.
- Transformed 300+ raw healthcare files using Databricks and PySpark, improving overall data quality and consistency.
Education
MSc in Data Science – VIT AP University (2021 – 2023)
BSc in Computer Science – BJB Autonomous College, Utkal University (2016 – 2019)