Akash Kagdelwar
Data Engineer
Hire this person
Send a job offer directly to this candidate
About
ETL Developer with 3+ years of experience in designing and optimizing scalable data pipelines using Databricks, Snowflake, and PySpark. Expertise in ETL development, big data processing, and SQL performance tuning. Proven track record of improving pipeline efficiency, ensuring data quality, and enabling data-driven decision-making
Experience
Software Engineer at Rigved Technologies Pvt Ltd (NCDEX) (2024-09 – Present)
ETL Developer designing and implementing scalable data pipelines using Talend and Databricks
- Designed and implemented 20+ ETL pipelines using Talend and Databricks, processing 100GB+ daily data from 6+ sources
- Built scalable PySpark pipelines using Delta Lake (Bronze/Silver/Gold architecture)
- Integrated structured and semi-structured data into Snowflake using COPY INTO and staging tables
- Implemented MERGE-based incremental loading and CDC pipelines in Snowflake
- Optimized Snowflake queries using clustering and warehouse scaling, improving performance by 20%
- Built automated data validation frameworks, reducing inconsistencies by 90%
- Resolved 15+ monthly data issues, maintaining 99.8% pipeline uptime
- Delivered 12–15 monthly CRs/FTRs/SRs, reducing backlog by 35%
Junior Data Analyst at ALLEGIANCE CONSULTANCY SERVICES PRIVATE LIMITED (2022-11 – 2024-08)
Data Analyst focused on automation, reporting, and data transformation
- Automated reporting using SQL, Python, and Excel, saving 40+ hours per cycle
- Optimized legacy SQL queries, improving performance by 30%
- Built dashboards using Power BI for business insights
- Performed data cleaning, transformation, and feature engineering on large datasets
- Delivered data solutions across multiple business units, increasing adoption by 20%
Education
Bachelor of Engineering in ME – Rashtrasant Tukadoji Maharaj Nagpur University (2016-08 – 2020-07)
