Subrat kumar Sahu
Data Engineer
Talent
BengaluruMember since September 24, 2026
PythonSQLSnowflakeAirflowKafkaPySparkFastAPIGCPGKEAzureDatabricksAWSS3EC2Athena
·
Hire this person
Send a job offer directly to this candidate
PythonSQLSnowflakeAirflowKafka
About
I design and scale distributed systems, real-time data pipelines, and microservices using Python, FastAPI, Apache Kafka, and Spark, with 5 years of experience. I specialize in event-driven architectures and cloud-native development (AWS, GCP, Azure), building high-performance, reliable, and cost-efficient systems at scale.
Experience
Software Engineer - III at Carelon Global Solutions (2024-06 – Present)
- Built event-driven microservices using Python, FastAPI, and Kafka to orchestrate and route streaming data across systems based on dynamic configuration.
- Developed scalable backend solutions for insurance domain workflows, implementing complex business logic and optimizing data processing with Snowflake.
- Designed ML orchestration services handling request validation (Pydantic), model inference, and persistent storage, enabling reliable and efficient prediction workflows.
- Improved system reliability and fault tolerance by implementing DLQ mechanisms, centralized logging (PostgreSQL), and deploying services on GCP GKE, Cloud Storage).
Data Specialist at Futurense Technologies (2022-12 – 2024-05)
- Built data pipelines using PySpark, Pandas, and AWS S3, Athena) to process vehicle service and billing datasets (~10 million records).
- Integrated multi-source datasets including job cards, billing data, vehicle metadata, and geographic mappings to enable unified analytics.
- Delivered analytics to identify high-failure vehicle categories, cost drivers, and warranty trends, contributing to a ~20% reduction in warranty costs.
- Orchestrated workflows using Apache Airflow and deployed pipelines on EC2, improving reliability and reducing manual effort.
Software Engineer at Capgemini (2021-10 – 2022-12)
- Built data pipelines using PySpark and Azure Databricks to process structured data.
- Assisted in building and maintaining data pipelines for structured datasets in cloud-based environments.
- Collaborated with team members to deliver scalable data solutions supporting analytics and reporting use cases.
- Strengthened fundamentals in distributed systems, data processing, and cloud-native development.
Education
B.Tech in ECE – Gandhi Institute for Technological Advancement (2017-08 – 2021-07)
Skills
Data Engineer