
Prudhvi Sai
Data Engineer
Hire this person
Send a job offer directly to this candidate
About
Data Engineer with 3 years of experience in the telecom domain, building Python and SQL pipelines that move, validate, and prepare data for analytics and reporting. Currently loading telecom usage files from AWS S3 into StarRocks through optimized Python ETL scripts (80+ partners, ~18M records/day in ~15 min, down from 30–45 min on MSSQL), moving the Power BI reporting layer off MSSQL, with chunked batch processing, reconciliation, and retry/logging controls. Previously built AWS S3 to Snowflake ETL workflows, transformed nested JSON into analytical tables, and automated partner invoicing that cut manual effort by ~90%.
Experience
Data Engineer / Data Science Engineer — Data Engineer: AWS S3 to StarRocks ETL for Power BI (Telecom) at VSigma IT Labs Pvt. Ltd. (2023-12 – Present)
- Moving the Power BI reporting layer from MSSQL to StarRocks: built optimized Python ETL scripts that load telecom usage files from AWS S3 into StarRocks over a MySQL connection, covering plans, users, and usage data for 80+ partners at roughly 18 million records per day.
- Used Pandas, SQL, and chunked batch processing (10,000 records per batch) with transformation before loading, scheduled daily with cron; the full load takes ~15 minutes versus 30–45 minutes on MSSQL.
- Implemented row-count checks, reconciliation, and data-quality validation on the new StarRocks tables.
- Added retry logic, error handling, and execution logging, and monitor loads with Graylog (logs) and Prometheus (metrics) with alerting on failures.
- Worked with the Power BI developer to deliver structured StarRocks tables (table type, partitioning, keys) shaped to their reporting requirements.
Data Engineer / Analytics Engineer at VSigma IT Labs Pvt. Ltd. (2023-12 – 2025-04)
- Built and maintained AWS S3 to Snowflake ETL workflows, scheduled daily with cron (45 min – 1 hr per run), and flattened nested JSON into structured tables for analytics.
- Automated daily revenue reporting (cron-scheduled) and monthly partner invoicing with Python, SQL, Excel, and Power BI, including usage-to-revenue reconciliation; reduced manual invoice preparation effort by ~90%.
- Moved the monthly revenue forecasting workflow into production as a recurring job.
- Built SARIMAX/ARIMAX and Exponential Smoothing models for GPRS, Voice, and SMS usage forecasting; applied K-Means and Differential Evolution to plan and cost optimization (AWS SageMaker).
- Built chatbot and Voicebot automation for telecom number porting (SmartPort AI) using Amazon Lex, Bedrock, and DynamoDB with backend API integration.
Data Analyst Intern at VSigma IT Labs Pvt. Ltd. (2023-06 – 2023-11)
- Performed EDA, data cleaning, and trend analysis on turbine data using Python and Pandas, alongside a Data Scientist.
Education
M.Sc. in Statistics – Krishna University, Nuzvid (2020-06 – 2022-04)
Data Science Certification Program – ExcelR, Hyderabad (2022-06 – 2023-05)
