Vishesh Shrivastava

Senior Data Engineer with 10 years of experience in Big Data Engineering, building scalable cloud-native data platforms, Realtime Streaming Pipelines, and Enterprise Data Warehouses across Banking & Financial Services, Betting & Casino, and Cryptocurrency domains, with strong expertise in ETL development, Reporting, and Analytics platforms.

• Senior Data Engineer at LiveScore Group (2023-08 – Present)
• Developed and deployed batch and real-time data pipelines from a new Sportsbook provider (API and Kafka) into the GCP BigQuery EDW using Apache Beam (Dataflow) and Airflow, improving Betting & Casino reporting efficiency with a 25% reduction in processing time and 15% improvement in data accuracy.
• Automated over 10 reports and downstream data workflows, addressing Data Warehouse and transactional system challenges, reducing report generation time by 30% and enhancing overall system efficiency by 20%.
• Senior Data Engineer at WazirX (2021-10 – 2023-07)
• Engineered as the sole Data Engineer for India's Biggest Cryptocurrency Exchange, creating from scratch a robust data pipeline that migrates MySQL & MongoDB data into Redshift using AWS Services, leading to a 33% cost reduction and a 50% performance gain annually.
• Integrated data from global cryptocurrency APIs to build dashboards for market analysis, resulting in an increase in customer acquisitions by 20%.
• Enhanced production database by implementing a historical data archiving solution, boosting order execution performance in Android and iOS applications by 25%.
• Data Engineer at Nice Software Solutions (2018-10 – 2021-10)
• Streamlined 10+ banking operations for a UAE client, automating dormancy protocols, crafting dashboards for Relationship Managers, and generating pivotal reports for Treasury, Forex, Capital Markets, and Correspondent Banking fund transfers.
• Architected and built ETL pipelines to automate ingestion of data from SQL Server & PL/SQL to a Data Lake, handling over 10 TB of data daily.
• Collaborated with levels of management to translate business requirements into actionable MicroStrategy reports, saving 20 hours weekly in manual efforts.
• ETL Developer at Tata Consultancy Services (2016-08 – 2018-09)
• Designed and implemented an ETL pipeline for migrating customer data from the legacy system (Siebel) and live transactional data to Salesforce, slashing time and costs by 30% on a $50M project.
• Collaborated with different application groups (Siebel, SAP, Salesforce, EAI) in 100% Agile project methodologies to prepare effective solutions for all programs.

Bachelor of Engineering in Computer Science – Visvesvaraya Technological University (2012-09 – 2016-06)