AWS-Data-Analyst-Python
Data Engineer & ETL Specialist
Hire this person
Send a job offer directly to this candidate
About
Accomplished Data Engineer & ETL Specialist with 5 years of profound experience with Reztech solutions and Networking Protocol Engineer at Fugnex in Telecom Domain. As data engineer, focused on real-time data processing and batch processing of datasets. Performed ETL operations using cutting-edge technologies. Good in Python ver 3.x, OOPS in Python, Flask Framework.
Building
Data pipelines, and the implementation of projects and data integration projects across various platforms like AWS till Production. Proficient in using tools such as PySpark, AWS Glue, Apache Kafka, AWS EMR, Hive, and Cassandra, ensuring seamless data processing, batch processing, and real-time analytics for large datasets. Skilled in Database Management with hands-on expertise in MySQL and PostgreSQL.
Good in Performance Optimisation using SQL and other Query Language like PostgreSQL. Good in using visualisation tools using tools like Tableau Cloud/Desktop & Power BI Dashboards. Can handle technical Interviews.
Experience
Data Engineer - Reztech - Delhi, India
(2022-01 - 2025-12)
Engineered and deployed ETL data processing pipelines using PySpark, Apache Kafka (Confluent), and AWS Redshift for real-time processing. Designed and developed ETL workflow for batch processing and transforming into structured format in AWS EMR, facilitating historical trend analysis. Developed and managed robust data pipelines connecting Apache Hive and Cassandra on AWS EC2, automating workflows and reducing manual tasks by 30%.
Performed detailed analyses of complex data sets using Python and MongoDB to provide actionable insights. Contributed to establishing a cloud-data warehouse on AWS, promoting the transition to an entirely cloud-native environment.
- Achieved 20% boost in data processing speed with minimal errors in the production environment.
- Performance Upgrade of Warehouse workflow.
- Executed performance tuning of MySQL databases through meticulous indexing and query optimisation, increasing data retrieval speed by 25%.
- Programmed a comprehensive suite of Python automation scripts for efficient data handling and reporting, saving approximately 10 hours of manual work per week.
- Developed bespoke data visualisation dashboards in Tableau, ensuring real-time tracking of essential performance metrics.
- Engaged directly with clients to deeply understand their data needs and delivered custom solutions aligned with their strategic objectives.
- Handled Large scale data by leveraging distributed processing using EMR in AWS.
Protocol Testing and Development Engineer - Fugnex - Bangalore, India
(2021-08 - 2022-04)
1.5 year project experience in Networking Protocols with Perl script.
Education
Post Graduate Diploma - Big Data Analytics (PGDBDA) - Centre For Development of Advance Computing (2023-01 - 2025-12)
Master of Computers Application - MCA - Sri Shankracharya College of Engineering and Technology

