Full Stack Developer
Send a job offer directly to this candidate
Collaborated with Product Owners and stakeholders to develop the technical architecture for a Data
Quality project, ensuring alignment with business and solution requirements.
Designed and implemented scalable ETL pipelines using Azure Databricks, Azure Data Factory
(ADF), and PySpark for efficient data movement.
Ingested structured and unstructured data from Azure Data Lake Storage (ADLS), SQL Server,
CosmosDB, and external APIs into Azure Synapse Data Warehouse (DWH).
Developed real-time and batch data pipelines using Kafka, Event Hubs, and Delta Lake for lowlatency data processing.
Optimized data partitioning and indexing in Apache Spark and SQL Server to improve query performance.
Implemented change data capture (CDC) mechanisms in ADF to track incremental data loads.
Optimized Spark job performance by tuning configurations, caching strategies, and efficient partitioning, reducing execution time by 40%.
Implemented monitoring dashboards using Datadog, PagerDuty, Azure Monitor, and Prometheus to track pipeline health and performance.
Configured alerting mechanisms in ADF, Azure Log Analytics, and CloudWatch for proactive issue resolution.
Automated error handling, logging, and retries in ADF and Databricks Workflows for robust pipeline execution.
Developed data models in Power BI, Tableau, and Looker for insightful reporting and analytics.
Integrated with REST APIs, SAP HANA, and third-party data sources to enrich datasets.
Enabled near real-time reporting using Synapse Link and Kafka Streams.
Version-controlled SQL scripts, ETL configurations, and transformations using dbt and Git.
Master’s in Computer Science| University of North Texas| Denton, TX
Bachelor’s in Computer Science | Jawaharlal Nehru Technological University| Hyderabad, India