Jyoti Pathak

Data Engineer & ETL Specialist with 13+ years of experience in data warehousing across Banking, Airline, and Retail domains. Strong expertise in IBM DataStage, including ETL design, parallel job development, and performance optimization. Proven ability in data mapping, cleansing, validation, reconciliation, and production support to ensure reliable data pipelines.

Built a strong foundation in data warehousing during a 10-year tenure at Teradata, with deep experience in enterprise data systems and data quality management.

Senior SW Engineer - Northern Trust

(2020-08 - 2023-04)

• Implemented complex transformations using DataStage
• Supported production batch loads, troubleshooting ETL failures, and resolving data issues within SLA timelines.
• Optimized DataStage jobs for performance and scalability, reducing runtime and improving batch processing efficiency.
• Collaborated with cross-functional teams to built and managed business-critical reports and dashboards, ensuring accuracy, clarity, and accessibility for diverse stakeholder groups.
• Worked on DataStage to Pyspark,Snowflake migration initiatives, modernizing legacy ETL pipelines into cloud-based data warehouse architecture
• Managed and validated source files in Unix environments, including file transfers, permissions, archiving, and preprocessing for ETL workflows.
• Earned SnowPro Core Certification (Snowflake).
• Maintained technical continuity through upskilling in cloud-based data platforms, and orchestration frameworks like -Airflow.
• Developed familiarity with distributed processing concepts (pyspark).

Technical Lead - Teradata - Teradata

(2010-06 - 2020-07)

• Built and maintained scalable ETL workflows in IBM DataStage to support enterprise-level data integration projects.
• Reduced ETL runtime by tuning SQL queries, DataStage stages, and Teradata database operations.
• Designed and developed complex DataStage Sequencer jobs to orchestrate multiple dependent ETL workflows in a controlled batch processing environment.
• Led and delivered server migration projects(1k+ Datastage Jobs), including planning, mapping, cleansing, and loading.
• Performed data analysis to detect discrepancies and resolve issues in an efficient and structured manner.
• Strengthened operational stability by automating job failure monitoring and alerts using Unix.
• Worked extensively with Unix commands to troubleshoot file-related issues, monitor disk space, manage directories.

CareerBreak / Professional Development

(2023-05)

Earned SnowPro Core Certification (Snowflake). Maintained technical continuity through upskilling in cloud-based data platforms, and orchestration frameworks like -Airflow. Developed familiarity with distributed processing concepts (pyspark).

Masters in Computer Applications - Computer Applications (2006 - 2009)

Bachelor of Computer Science - Computer Science (2003 - 2006)