Uthamkrishna Kolichalam

Azure Data Engineer with 4.6+ years of experience in Azure Databricks, PySpark, SQL, ADLS Gen2 and Delta Lake. Skilled in developing scalable ETL pipelines, implementing data transformation frameworks, and optimizing Spark workloads for performance and reliability. Experienced in Medallion Architecture, Unity Catalog, Structured Streaming, Autoloader, Azure Devops CI/CD, and Databricks Workflows.

Strong experience in data ingestion, transformation, and managing data processing across DEV, UAT and production environments.

Azure Data Engineer at Infinite Computer Solutions (2022-10 – Present)

• Collaborated with cross-functional teams to understand data requirements and design scalable data processing workflows using Azure Databricks.
• Designed, developed, and maintained ETL pipelines to ingest data from multiple sources and transform it into structured, curated datasets for analytics and reporting.
• Optimized Spark jobs and ETL pipelines by enhancing query performance, partitioning strategies, and resource utilization, achieving 30–40% reduction in processing time.
• Leveraged Azure DevOps CI/CD pipelines to deploy Databricks artifacts across UAT and production environments, ensuring reliable and efficient code promotion.
• Led the implementation of Unity Catalog in Azure Databricks, enabling centralized data governance, fine-grained access control, and enhanced data security across the organization.
• Owned end-to-end data pipeline performance by proactively identifying bottlenecks, resolving defects, and ensuring stable and efficient and reliable data operations.
• Automated and scheduled data pipeline executions using Autosys, reducing manual intervention and improving overall workflow efficiency and reliability.

Software Engineer at Webmatics Solutions (2021-11 – 2022-09)

Bachelor of Engineering in Electronics and Communication – Khammam Institute of Technology and Sciences