Tiragati Venkatesh

A passionate Data Engineer & Gen AI Developer with 4 years of experience and strong focus on Generative AI, I thrive on transforming raw data into valuable insights that drive business decisions. With a solid foundation in data architecture, pipeline development, and advanced analytics, I excel in building scalable, efficient data pipelines and solutions by leveraging AWS, SQL, Databricks and PySpark technologies.

Digital Specialist Engineer | Data Engineer at Infosys Ltd (2022-07 – Present)

• Designed, developed, and implemented multiple end-to-end ETL pipelines using Databricks, PySpark, and SQL, enabling efficient processing of structured and semi-structured data.
• Implemented comprehensive data quality checks using Soda Core within a Databricks/Prophecy pipeline, ensuring data integrity for downstream consumption.
• Configured automated email notifications triggered by Prophecy for pipeline failures and detected data discrepancies, ensuring immediate awareness and proactive incident response.
• Automated incident creation in ServiceNow upon pipeline failure by integrating Soda alerts with AWS Lambda, significantly streamlining the incident management and resolution process.
• Monitored, troubleshot, and maintained data pipelines, resolving 95% of Databricks job failures within SLA, ensuring high availability and minimal data delivery delays.
• Architected and implemented a modern Data Lakehouse using Databricks on AWS S3 unifying raw data storage with structured processing to support both BI reporting and advanced Generative AI workloads.
• Leveraged the Sonet 3.5 LLM (GenAI) to automate the creation of Jira tickets, enhancing efficiency and reducing manual overhead in task logging.
• Developed a BI Developer Assistant tool utilizing Sonet 3.5, capable of code generation, query optimization, and architectural diagram explanations, substantially boosting developer productivity.
• Pioneered the use of Sonnet 4 LLM and GPT-4o for multimodal code generation, successfully converting complex technical architecture diagrams and Figma images into high-quality, usable code.

B.Tech in Mechanical Engineering – Raghu Engineering College (2022)