Parth Kumar

Data Engineer with 4+ years of experience across data engineering and software development, specializing in AWS, PySpark, SQL, and Apache Airflow. Experienced in building scalable ETL pipelines, data lakes, real-time processing systems, and analytics-ready data platforms

Cloud Data Engineer at Promethean Energy (2023-06 – 2025-12)

• Designed a batch data pipeline processing 40+ GB/day using AWS Glue (PySpark) and S3. Implemented partitioning, transformation, cleansing, and aggregation logic to build analytics-ready structured datasets optimized for reporting downstream and querying workloads. Built a scalable data lake with partitioning and distributed processing. S3 event notifications and Lambda-based schema/timestamp validation, incremental consolidation of hourly telemetry files, distributed PySpark transformations, partitioned S3 data lake storage and automated archival/lifecycle management to optimize scalability, fault tolerance and ETL processing costs.
• Built a scalable real-time telemetry pipeline using AWS SQS, Lambda, and RDS with event-driven streaming architecture for low-latency ingestion and processing. Designed event-driven architecture with SQS.

Created

Lambda functions for decoding, validation and transformation.

• Implemented data validation, monitoring, retry handling, and alerting to improve pipeline reliability and data quality across batch and streaming workflows. Built analytics-ready datasets and automated reporting workflows for BI and operational monitoring.

Optimized

PostgreSQL queries using indexing strategies (BRIN/B-Tree), execution plan analysis, and query tuning for large-scale time-series datasets.

Software Engineer at Qdnet Technologies (2021-06 – 2023-06)

• Implemented a server processing 5000+ GPS packets/min to track 2500+ vehicles in real time.

Planned

Python-based reporting scripts for analytics and PDF generation from PostgreSQL data.

• Developed a websocket server in Python to handle real-time communication with EV charging applications, processing events such as start/stop charging, transaction updates and billing using JSON messages.

Bachelor of Engineering in Electronics & Telecom Engineering – Don Bosco Institute of Technology, Mumbai, India (2017-05 – 2021-05)