Data Engineer | Infinity Data Technologies Pvt Ltd.
Send a job offer directly to this candidate
Big Data Engineer with 1.5+ years of experience in leveraging Big Data tools and technologies to deliver scalable data solutions. Designed and Optimized an end-to-end data pipeline using Kafka, Spark, and SQL to process high-volume real-time Banking Transaction Data. Optimized an end-to-end data pipeline using Apache Spark, SQL, and AWS Glue to process HealthCare Insurance Domain Data.
Managing data ingestion, Performing Transformations like cleaning, enrichment and lastly loading that data into the data warehouse. Collaborated closely with data scientists and business analysts to comprehensively understand project requirements, ensuring data solutions met business objectives. Automated workflows using Apache Airflow and ensure efficient management of CI/CD pipelines.
Data Engineer - Infinity Data Technologies Pvt Ltd.
(2023-11)
B-Tech - Computer Science and Engineering - BATU University Aurangabad (2023-09)
H.S.C (2019-02)
S.S.C (2017-03)