Abhishek Mane

Data Engineer with 5 years of experience in the development and maintenance of big data pipelines with precise cloud cost optimization & smart data engineering using modern GenAI Tech Stack to fast pace the data journey of the product.

Data Engineer at VISA Inc (2024-10 – Present)

• Developed data pipelines processing up to 50TB of data for the Latin America & Europe region, leveraging Pyspark, Presto, Trino, Hive, and HDFS which helped stakeholders to take critical business decision
• Analyze the fintech market landscape using a medallion architecture-based data lakehouse to determine market volume, identify periods of significant growth and uncover areas for potential improvement which employs complex aggregation techniques and leverage established data warehousing principles to provide comprehensive insights
• Usage of GenAI tools like GitHub Co-Pilot, Cline, Microsoft co-pilot Studio, LLMs model like gpt-4o, gpt-o1 & claude sonnet To debug & develop codes, data quality & QC framework and development of prototypes using Prompt Engineering
• Development of the automated pipeline for the extraction of data from JIRA API into MySQL Db

Data Engineer at Viu India Pvt Ltd. (2022-01 – 2024-09)

• Designed data pipelines for Business KPIs using customer engagement platforms which benefitted in keeping track of cost optimization of cloud usage to make precise developments in Python and SQL
• Automated the Business metrics reports from POC to Production, resulting in eliminating human intervention, which improved the productivity of deliverables and zero manual errors, with the use of Data Proc GCP service
• Migration of Airflow DAGs from legacy version to latest inline with the cloud composer
• Seamless integration to leverage GCP's infrastructure for Snowflake's performance and Data Ingestion using Snowpipe with Google Cloud Storage events for automated data loading.
• Integrated on premises setup to GCP

Data Engineer Intern at Viu India Pvt Ltd. (2021-07 – 2022-01)

• Implemented user acquisition using statistical tools like Mean & Standard Deviation, which increased profit by 15% after high subscription conversion of trial-based users
• Evaluated and debugged streaming and batch data pipeline on Google Cloud Platform up to data size between 500GB to 20TB; resolved existing issues by using the services like dataflow, pub-sub, and bigquery by using Python and SQL

Executive Management Program in Master of Management Studies – Indian Institute of Management, Indore (2025-04)

Bachelor of Engineering in Electronics & Telecommunications – Savitribai Phule Pune University (2017-08 – 2021-05)