Shoaib Khan

Data Engineering Leader with 15+ years of experience building and managing enterprise ETL pipelines, cloud analytics platforms, and data warehouses at scale. Expert in IBM InfoSphere DataStage (8.x, 11.x), AWS (EC2, S3, Redshift, Glue), SQL, Python, and Shell Scripting. Proven track record of reducing ETL processing time by 40%, improving data quality from 94% to 99.5%, and maintaining 99.9% SLA compliance across 500+ production jobs.

Strong background in DataStage administration, CI/CD automation, data governance (RBAC, LDAP), Agile delivery, and leading cross-functional teams of 8+ engineers across Telecom and Healthcare domains.

Associate Manager – Data Engineering Specialist at Accenture India Pvt Ltd (2020-10 – Present)

Project: Vantive Kidney Care Analytics Platform (Aug 2024 – Present)

• Architected IBM InfoSphere DataStage 11.x infrastructure on AWS EC2 supporting 200+ ETL parallel jobs processing 50M+ records daily
• Engineered CI/CD pipeline using Jenkins and Git, reducing deployment time by 60% across development, test and production environments
• Implemented LDAP/AD integration and RBAC access control for 50+ users, ensuring HIPAA-compliant data governance
• Optimised DataStage parallel processing configurations, improving job performance by 45% and reducing batch window from 8 hours to 4.5 hours
• Developed Control-M monitoring and alerting framework, reducing incident response time by 70%
• Led zero-downtime DataStage platform upgrades and cloud infrastructure migrations with cross-functional teams
• Managed end-to-end delivery of data engineering projects, led team of 8+ engineers, and maintained 99.9% uptime SLA

Service Delivery Specialist – ETL Technical Operations Analyst at IBM India Pvt Ltd (2010-11 – 2020-09)

Project: Bharti Airtel Executive Information System (EIS)

• Designed and maintained mission-critical DataStage ETL pipelines integrating 15+ heterogeneous data sources, generating daily and monthly GL entries for USD 15B+ telecom revenue with 99.9% SLA compliance
• Developed complex DataStage parallel job transformations handling 500GB+ daily data volume; built automated reconciliation framework reducing data discrepancies by 85%
• Engineered real-time data quality validation checks, improving data accuracy from 94% to 99.5%
• Led DataStage 8.x to 11.x platform upgrade, successfully migrating 300+ production ETL jobs with zero data loss and comprehensive regression testing
• Implemented Tivoli Workload Scheduler automation, reducing manual job interventions by 80% and enabling earlier delivery of critical financial reports
• Collaborated with Finance, MIS, and BI teams to deliver Cognos BI OLAP cubes and executive dashboards for C-level decision-making
• Provided 24/7 L2/L3 production support achieving 95%+ incident resolution within SLA across 500+ ETL jobs
• Delivered 20+ Agile sprint projects with zero production incidents and 100% on-time completion
• Mentored team of 5 DataStage developers, establishing ETL best practices, code review standards, and documentation
• Led performance tuning initiative reducing ETL batch processing time by 40%, enabling earlier delivery of critical business reports

Master of Computer Applications in Computer Applications – Maharishi Dayanand University (2010)