Yaswanth Yasu

Databricks Engineer with hands-on experience building production data pipelines and lakehouse solutions on Azure. Experienced in PySpark, Delta Lake, SQL, and dbt for data transformation, database integration, and migration, with a strong focus on performance and data quality. Enjoy solving real data problems and building reliable solutions for production environments.

Junior Azure Databricks Engineer at CloudRaptor (2025-07 – Present)

Project Client: Sony. Part of the database team integrating data from four source databases into a single target database, creating and maintaining 50+ target tables using SQL Server and SSMS.

• Develop SQL-based dbt models using CTEs, joins, Window Functions, and other transformation logic to combine source data into unified datasets for target tables.
• Develop dbt intermediate models and macros to transform view level data into final target tables, with dbt tests covering data accuracy, duplicates, row counts, and join validation.
• Perform source to target validation and reconciliation to ensure migrated data meets expected business and transformation rules.
• Built and maintained production pipelines for Stakeholders TDtoLake, GenbaToLake, and BeToLake using Azure Databricks, PySpark, and Delta Lake across Bronze, Silver, and Gold layers.
• Optimized ETL and ELT workflows and Spark jobs, reducing pipeline execution time by 30–40% through improvements to transformations and job structure.
• Owned transformation logic, data validation, and production deployments for assigned pipelines while collaborating with stakeholders on requirements.
• Designed a housekeeping POC to identify and clean up stale and redundant data, reducing storage footprint and cluster usage by 15–25%.

Associate System Engineer at Tata Consultancy Services (2024-07 – 2025-06)

Project Client: Bank of America. Worked as part of a data engineering team, contributing to development and maintenance of data pipelines using Azure Databricks and PySpark.

• Worked on ETL processes to structure and prepare data for analytics, ensuring data consistency and quality.
• Assisted in debugging, monitoring, and optimizing jobs to improve pipeline reliability and performance.

Bachelor of Technology in Computer Science Engineering with specialization in AI – Vellore Institute Of Technology (2020-09 – 2024-07)

Higher Secondary Education in M.P.C (Maths, Physics, Chemistry) – Sri Chaitanya Junior College (2018-06 – 2020-05)