PawanKumar Yandapalli

Data Engineer experienced in designing and building scalable, cloud-native data platforms on AWS and Azure.

My expertise includes ETL/ELT and CDC pipelines using PySpark, Databricks, AWS Glue, and DBT, as well as implementing data warehouses and lakes in Redshift, Snowflake, and Azure Data Lake/ADF. I focus on delivering high-performing, secure, and cost-efficient solutions, leveraging Terraform, CI/CD, and containerization (Docker/Kubernetes) to build reproducible infrastructure at scale.

💡 Key Highlights

Designed and automated pipelines to ingest, transform, and model large-scale datasets across AWS & Azure.

Optimized Spark/Databricks jobs for performance and cost efficiency.

Built analytics-ready repositories in Redshift, Snowflake, and Databricks with governance and traceability.

Partnered with data scientists, BI analysts, and engineers to deliver clean, reliable, and analytics-ready data.

Implemented security, access controls, and compliance standards (HIPAA, GDPR).

Professional Summary

Experienced Data Engineer with over 5 years of expertise in designing and managing large-scale data infrastructure and analytics solutions across AWS, Snowflake, and Redshift ecosystems. Proven track record in building ETL/ELT pipelines, optimizing data workflows, and automating data ingestion using Python, PySpark, and SQL. Skilled in containerization (EKS, Docker), workflow orchestration (Airflow), and infrastructure as code (Terraform, Jenkins).

Strong focus on data governance, scalability, and compliance (HIPAA/GDPR).

Core Strengths

• ETL/ELT development and automation
• AWS (Glue, Redshift, EMR, Lambda, Step Functions)
• Data pipeline orchestration (Airflow)
• Cloud-native architecture (EKS, Terraform, CI/CD)
• Python, PySpark, SQL
• Data modeling, analytics, and governance

Previous Roles:

• Data Engineer, TouchWorld (Feb 2025 – Present) — Remote, USA
• Data Engineer, Amazon (Sep 2020 – Jul 2023) — Hybrid, India
• Associate Software Engineer, GSPANN Technologies (Aug 2019 – Sep 2020) — On-site, India

Master’s in Computer Science — University of the Pacific (Aug 2023 – Dec 2024)

Focused on cloud computing, data engineering, and applied machine learning, with coursework in web applications, security, and data visualization.

Key courses include

• Python Essentials for Machine Learning
• Database Management Systems II
• Cloud & Mobile Security
• AI in Healthcare
• Storytelling and Visualization (BI Tools)

Bachelor’s in Electrical, Electronics, and Communications Engineering — Vishnu Institute of Technology (Aug 2015 – Apr 2019)

Built a strong foundation in digital systems, embedded systems, and automation, with hands-on experience in sensor integration and control systems.

• Final Project: Autonomous Farming Robot — developed an automated agricultural robot integrating sensors and control systems.
• Minor Project: High-Speed Low-Power Circuits Using Reversible Logic — optimized circuit efficiency and power use.