Abhishek Batagi

Data Engineer with hands-on experience building real-time and batch data pipelines at scale. Skilled in Kafka, Flink, Spark, Python, Java, and AWS to ingest and transform high-volume telemetry into analytics- and ML-ready datasets. Strong background in data flows, system design, schema design, and cloud infrastructure setup. Recognized with multiple awards for delivering scalable solutions and cross-team leadership.

Data Engineer at Oben Electric (2024-04 – Present)

Leading architectural design and scalability of real-time data ingestion pipelines for connected vehicles. Developing stream processing jobs, optimizing Kafka infrastructure, managing IoT security and cloud infrastructure. Driving cross-functional collaboration and data governance initiatives.

• Architected end-to-end real-time data ingestion pipelines supporting 50k+ connected devices, handling 18M+ events/hour with sub-second latency
• Developed and maintained 6+ production Apache Flink jobs in Java for real-time data transformations, anomaly detection, and geo-fence alerting
• Optimized Kafka infrastructure by designing custom partitioning, retention, and log compaction strategies to ensure low-latency ingestion and eliminate consumer lag incidents
• Resolved a major scalability bottleneck by implementing 'Provision by Claim' using AWS IoT Core, automating certificate lifecycle management for secure and seamless fleet onboarding
• Owned the setup and operationalization of AWS infrastructure, including VPC design, Security Groups, Kafka clusters
• Established monitoring runbooks and automated ETL workflows using Python to generate daily summaries, reducing manual operational reporting effort
• Served as the lead for vendor management and data migration, successfully redirecting vehicle telemetry into Oben's infrastructure with near-zero data loss
• Acted as the technical bridge between Hardware, Firmware, and Product teams to define telemetry events, data contracts, and schema evolution strategies

Data Analyst (Intern) at Oben Electric (2023-12 – 2024-03)

Supported initial fleet telemetry ingestion and reporting efforts. Built Python ETL scripts, created dashboards and automated reports, and contributed to telemetry schema definition.

• Supported initial fleet telemetry ingestion and reporting efforts; built Python ETL scripts to clean and load telemetry into staging stores
• Created early dashboards and automated reports to help R&D observe vehicle behavior and validate telemetry quality
• Contributed to defining telemetry schema and basic validation rules used in production

Data Analyst (Intern) at Karkhana.io (2023-10 – 2023-11)

Implemented web-scraping pipelines to collect product and pricing data. Performed exploratory data analysis and automated data ingestion processes.

• Implemented web-scraping pipelines to collect product and pricing data, cleaned and normalized datasets for business reporting
• Performed exploratory data analysis and produced actionable insights used by product/ops teams
• Automated scraping and ingest pipelines to run on schedule and deliver clean CSV/DB dumps to stakeholders

Bachelor of Engineering – MES College of Engineering Pune (2023)