Antony Chris Sam P

Data engineer with over four years of experience building scalable data pipelines for businesses. I possess expertise in designing and managing data lakes on cloud platforms like Azure and on-premise, to integrate and store complex, large-scale data. Skilled in data modeling techniques, I ensure accurate and reliable data for data marts and machine learning models.

Proven ability to deliver high-performance data solutions using Python, Spark, SQL, and the Hadoop ecosystem. I further enhance my skills by developing real-time streaming applications with Apache Flink and Spark for efficient data processing.

Big Data Engineer - Capgemini - Bangalore

(2024-09)

• Developed a Python-based Spark script with custom UDFs to filter invalid timestamps, reducing production job failure rates by 40% and ensuring data consistency across downstream analytics
• Automated 20+ data workflows using Apache Airflow, which eliminated approximately 10 hours of manual monitoring per week and improved ingestion reliability to 99.9%
• Optimized BigQuery performance and cost-efficiency through the strategic implementation of table partitioning and clustering for large-scale datasets

Data Engineer - Jio - Navi Mumbai

(2022-03 - 2024-09)

• Architected a scalable framework for streaming applications leveraging Apache Kafka for real-time data ingestion, Apache Flink for stateful processing, and Apache Spark for large-scale computations.
• Collaborated with Business Analysts to build data models for KPIs, directly contributing to a more targeted and effective product development strategy and Business Intelligence.
• Collaborated with Data Scientists on data ingestion and job scheduling, ensuring timely and accurate data availability for Forecasting and Anomaly Detection Model.
• Migrated the traditional SCD application for the Jiomart Datamart to Iceberg, achieving a significant 60% improvement in process efficiency, which translates to minimize latency in dashboards.

Bachelors - Computer Science Engineering - Mepco Schlenk Engineering College (2011-08 - 2015-05)

Masters - Big Data Analytics - Goa Institute of Management (2020-07 - 2022-03)