Siddhi Khetan

Results-driven Data Engineer with experience at Genpact, specializing in ETL pipeline development and data warehousing. Enhanced performance by 30% through optimized Databricks workflows and effective collaboration with cross-functional teams. Proficient in PySpark and Apache Airflow, with a strong focus on automation and delivering impactful data solutions.

Data Engineer at Genpact (2023-07 – Present)

• Owned and optimized end-to-end ETL pipelines on Databricks using PySpark and SQL, improving pipeline performance by 30% through Spark job tuning, query optimization, and modular architecture, cutting daily batch processing time significantly.
• Designed and delivered end-to-end ETL pipelines in Talend, ingesting and transforming data from diverse source systems into a centralized data warehouse.
• Automated and orchestrated production workflows using Apache Airflow, scheduling and monitoring Databricks and Talend jobs with logging and alerting for reliability.
• Designed and maintained dimensional data models (facts & dimensions) in Databricks, including tables and views to support downstream analytics and reporting.
• Partnered with data engineers, analysts, and product owners to translate business needs into effective data solutions, reducing average resolution manual efforts, delivering 2 use cases every week.
• Independently learned and deployed AI workflow automations using n8n, rolling out solutions for business-specific use cases that cut manual handoffs across teams, leading a team of 4 engineers.
• Created an AI agent tailored to automate decision-making processes, integrated into workflows to enhance efficiency, cutting manual efforts.

Software Engineer Intern at Genpact (2023-03 – 2023-07)

• Designed and built responsive, user-friendly interfaces using ReactJS, implementing API integrations for real-time data retrieval and dynamic content display.
• Enforced secure user authentication and authorization within ReactJS applications, ensuring protected resource access.

B.Tech in Computer Science & Engineering – Graphic Era University (2019 – 2023)

12th Grade in CBSE – The Aryan International School (2018 – 2019)