Venkat Singaram
Data Engineer
Talent
HyderabadMember since May 19, 2026
PythonSQLDatabricksAWS GlueAzure Data FactoryAzure Data LakeComplex SQL queriesQuery optimizationDistributed SystemsPostgreSQLAzure SQLJupyter NotebooksPandasExcel
·
Hire this person
Send a job offer directly to this candidate
PythonSQLDatabricksAWS GlueAzure Data Factory
About
Results driven Data Engineer with hands-on experience designing scalable ETL pipelines and building cloud-based data platforms using AWS, Azure, and Databricks. Strong expertise in SQL optimization, distributed data processing, and data validation. Experienced in handling large-scale datasets, building scalable data pipelines, and automating workflows.
Experience
Junior Data Engineer (Public Sector Analytics & Automation) - Prajna IT Solutions
(2025-01 - 2026-02)
- Designed and deployed 8+ scalable ETL pipelines using Python and both AWS (Glue) and Azure Data Factory for processing structured and semi-structured data
- Built and maintained Databricks pipelines using Spark for data ingestion and transformation
- Built automated ingestion pipelines handling 800GB+ datasets annually, integrating cloud storage (S3, Azure Data Lake) with databases (PostgreSQL, Azure SQL, Redshift)
- Implemented incremental data loading strategies, reducing pipeline processing time by 35% and improving system efficiency
- Developed and optimized complex SQL queries, improving analytics performance by 25% and reducing query execution time
- Performed query optimization and troubleshooting, identifying bottlenecks in large datasets and improving database performance
- Monitored production pipelines, analysed logs, and debugged failures, ensuring high system reliability and uptime
- Designed data warehouse schemas (Fact & Dimension models) supporting scalable analytics workloads
- Integrated multiple cloud services and databases to deliver end-to-end data solutions across AWS and Azure
Data Analytics Intern (Academic Insights & Dashboarding) - Anurag Group of Institutions - Level up Cloud Solutions
(2024-01 - 2024-06)
- Designed and implemented a student performance tracking dashboard using Excel to identify subject-level trends
- Used Jupyter Notebooks and pandas to clean academic data and generate insights across departments
- Wrote SQL queries to assist academic teams in generating customized reporting for internal review
- Regularly presented findings in visual format to faculty heads and contributed to data-informed planning
- This internship served as the foundation for a successful pivot from Mechanical Engineering to Data Analytics
Education
Bachelor of Engineering - Mechanical Engineering - Anurag Group of Institutions (2018 - 2022)
Skills
Data Engineer
