Shubham Popade

Data Engineer with 3+ years of experience in designing, building, and optimizing scalable ETL pipelines and cloud-based data solutions. Strong expertise in Python, SQL, PySpark, and AWS services including Glue, S3, Redshift, and Lambda. Proven ability to process large-scale data (200+ GB daily), improve performance, and deliver reliable, production-ready data pipelines for analytics and business intelligence.

Data Engineer - Substle Solution - Pune

(2022-01)

• Designed and maintained scalable ETL pipelines using AWS Glue and Databricks.
• Processed structured and semi-structured data using Python, SQL, and PySpark.
• Integrated data from MySQL, AWS S3, and SQL Server with strong data validation and quality checks.
• Built and optimized data lakes (S3) and data warehouses (Redshift) for analytics and BI.
• SQL query tuning.
• Managed 10+ ETL pipelines processing 200+ GB of data daily.
• Improved data processing performance through Spark optimization.
• Worked on Snowflake data warehouse for analytics.
• Collaborated with cross-functional teams in Agile/Scrum environments.

Bachelor of Engineering - EEP - Dr. Babasaheb Ambedkar University (BAMU) Aurangabad (2022-02 - 2024-12)