Data Engineer
Send a job offer directly to this candidate
Highly motivated Data Engineer with 2.5+ years of expertise in constructing and enhancing scalable data pipelines and architectures. Proficient in Big Data technologies such as Hadoop, Sqoop, Hive, and Spark, alongside adeptness in Google Cloud tools including Dataproc, BigQuery, Cloud Composer, and Dataflow. Skilled in data processing, ETL development, and executing data analysis to derive actionable insights.
Demonstrated success in preserving data integrity, boosting performance via optimization techniques, and utilizing cloud solutions for streamlined data workflows. Enthusiastic about resolving intricate data challenges to bolster business goals. Experienced in maintaining optimized and efficient data ecosystems and processes.
● Performed cloud modernization and did cost saving by having spark code run on LA DP cluster for ETL process.
● Worked on Data munging, wrangling, curation, customization, enrichment, analytical and windowing techniques.
● Handled multiple fi le formats such as text fi le, CSV, ORC, JSON.
● Worked on end-to-end ETL pipeline in BigQuery and Spark..
● Performed automation using Cloud Composer.
● Handled performance optimization by using Compression, Partitioning, Bucketing, Pushdown Optimization.
Completed my highest graduation in MBA with specialization of Marketing and Finance with 7.9 CGPA
Completed under graduation in B.Sc. Mathematics with 7 CGPA
