Manvi Lather
Azure Data Engineer
Hire this person
Send a job offer directly to this candidate
About
Results-driven Azure Data Engineer with 4+ years of experience designing, developing, and deploying data pipelines using Azure Data Factory and Databricks, backed by an additional analyst background in database and geodatabase development. Skilled in data transformation, ETL/ELT processes, and database management across enterprise-scale environments. Seeking a challenging Data Engineer role to leverage strong technical expertise and analytical skills.
Experience
Senior Software Engineer (Data Engineer) - HCHB - Dallas, TX
(2022-05 - 2026-07)
- Developed end-to-end data pipelines using Azure Data Factory, Azure Databricks, and Data Lake Storage Gen2 within a medallion architecture (Bronze, Silver, Gold).
- Implemented data ingestion from on-premise SQL Server databases into Azure Data Lake using Self-Hosted Integration Runtime (SHIR) in ADF.
- Created parameterized pipelines, dynamic datasets, and lookup activities for reusable, scalable ETL/ELT workflows.
- Optimized PySpark transformations in Databricks to improve performance by 30% using Delta Lake, partitioning, and caching techniques.
- Automated data workflows enabling real-time and batch processing through event triggers, debug settings, and failover handling in ADF.
- Designed and implemented CI/CD pipelines using Azure DevOps and ARM templates for seamless deployment of Data Factory and Databricks assets.
- Integrated Azure Key Vault to securely manage secrets, access tokens, and linked-service credentials across environments.
- Collaborated directly with clients and stakeholders to gather requirements, create technical design documents, and drive end-to-end data platform delivery.
- Implemented data quality checks, logging, and monitoring using Azure Monitor, Log Analytics, and custom alert rules for production pipelines.
- Ensured data governance, RBAC, and GDPR compliance in enterprise-scale Azure data solutions.
Graduate Teaching Assistant - University of North Texas - Denton, TX
(2021-10 - 2022-05)
- Supported courses in Data Warehousing, Data Mining, Machine Learning for Business, and Database Management Systems by creating instructional videos and helping students work through course material.
- Graded assignments and proctored exams to university standards; assisted students through office hours and one-on-one support.
Senior Analyst (Geodatabase Developer) - RAMTeCH Software Solutions - India
(2019-03 - 2019-12)
- Improved database performance through regular maintenance tasks using SQL scripts and ESRI tools.
- Managed development databases, upgrades (Oracle 11g to 12c), migrations, and DBA tasks.
- Performed DML/DDL operations and created database objects to meet business needs.
Analyst (GIS Analyst) - ESRI - India
(2015-05 - 2019-03)
- Created Enterprise Geodatabase models using multiple DBMS platforms (SQL Server, Oracle, PostgreSQL).
- Created schemas, grants, stored procedures, functions, triggers, and packages.
- Created versions and replicas to enable multi-user data editing.
- Partnered with 3,000+ clients to interpret project requirements and recommend the best execution approach using the ESRI suite.
Education
Master of Science - Business Analytics - University of North Texas (2022)
Master of Science - Remote Sensing and GIS - Banasthali University (2015)
