Kaunain Khan
Data Engineer
Hire this person
Send a job offer directly to this candidate
About
Data Engineer with 4+ years of proven experience designing and delivering scalable ETL pipelines and data platforms. Expert in Python, PySpark, SQL, and AWS services (S3, Lambda, Redshift, Glue, Athena) with proficiency in Apache Airflow orchestration. Demonstrated expertise in building optimized production workflows that improved data quality, reliability, and reporting velocity.
Strong collaborator skilled at translating business requirements into robust data models, implementing monitoring and alerting systems, and driving performance and cost optimizations in cloud environments.
Experience
Data Engineer - LIKEDIN SERVICES PVT LTD - Bengaluru – Karnataka
(2025-05)
Project: Data Pipeline Orchestration with Apache Airflow
- Designed and implemented Airflow-based orchestration for ETL, transformations, and data loading across multiple business domains.
- Configured and maintained Airflow infrastructure including DAGs, operators, and connections; automated 50+ scheduled workflows with zero manual intervention
- Developed modular, reusable DAGs and custom operators to standardize ETL patterns, reducing development time by 35%
- Implemented SLA definitions, retry strategies, and comprehensive alerting to improve pipeline reliability to 99.5%+
- Collaborated with data engineers and stakeholders to manage complex task dependencies and optimize scheduling across enterprise workflows
Data Engineer - INFOSYS BPM - Bengaluru - Karnataka
(2024-05 - 2025-05)
Project: Customer Transaction Data Pipeline
- Implemented PySpark-based ETL to process and transform 100M+ transaction records from AWS S3 into AWS RDS (MySQL) datastore for business reporting
- Developed and optimized PySpark jobs, reducing data processing time from 4 hours to 45 minutes for daily transaction batches
- Built reliable ingestion workflows to extract data from S3, apply transformations, and load into MySQL with zero data loss
- Established comprehensive data validation and integrity checks to maintain 100% accuracy across pipelines
- Collaborated with analysts to design scalable data models and deliver datasets supporting real-time insights and business intelligence
Data Engineer - MPHASIS - Bengaluru, Karnataka
(2022-02 - 2024-05)
Project: Customer Ticketing Trend System
- Architected and implemented end-to-end ETL workflows using Apache Airflow, AWS S3, AWS Lambda, and Redshift to consolidate 5+ data sources into unified analytics platform
- Developed scalable data transformation scripts and cleansing routines, improving data quality from 82% to 98%
- Automated data ingestion and scheduling to ensure timely availability; reduced manual data prep time by 60%
- Implemented comprehensive monitoring, logging, and alerting to proactively detect and resolve pipeline failures; achieved 99%+ uptime
- Collaborated with product owners and analysts to translate complex business requirements into robust data models supporting trend analysis and reporting
Education
Bachelor of Computer Applications - Computer Applications - Bangalore North University (2021-05)
Pre-University Education - 12TH/PUC - Mahila Samaja PU College (2016-06 - 2018-04)
Secondary Education - S.S.L.C - Karnataka Secondary Education Examination Board (2016-05)
