Nishad Parab
Data Engineer / DevOps Engineer
Hire this person
Send a job offer directly to this candidate
About
Data Engineer / DevOps Engineer with 5+ years at Tata Consultancy Services (TCS), specializing in Databricks-based data engineering, large-scale cloud migration, and automation.
Databricks Certified Data Engineer
Professional with hands-on experience building PySpark pipelines, tuning Spark cluster performance, and governing data access through Unity Catalog. Led a Databricks-based on-premise-to-Azure migration for ABN AMRO (Amsterdam), offloading ~18 TB of historical data to Azure Data Lake Storage Gen2, alongside a separate petabyte-scale Teradata-to-Azure Synapse migration using Datometry. Experienced in Azure DevOps CI/CD automation and onsite technical delivery for international clients.
Experience
Data Engineer / DevOps Engineer at Tata Consultancy Services (TCS) (2021-01 – Present)
Client Engagement: ABN AMRO, Amsterdam — On-Prem to Azure Data Migration
- Developed and implemented a scalable data offloading framework using PySpark on Azure Databricks to migrate ~18 TB of historical data from on-premise and cloud databases to Azure Data Lake Storage Gen2.
- Built parallel PySpark-based JDBC ingestion pipelines for DB2, optimizing data extraction and leveraging Spark Adaptive Query Execution (AQE) to improve query performance and cluster efficiency.
- Implemented a partitioned data archival strategy using date-based directory structures for efficient historical data organization and retrieval in ADLS.
- Integrated with Unity Catalog to enable governed, discoverable, role-based access to historical datasets across the organization.
- Optimized Databricks cluster configurations for high-throughput parallel processing, improving overall runtime efficiency by ~40% and reducing compute costs.
Data Engineer / DevOps Engineer at Tata Consultancy Services (TCS) (2021-01 – Present)
Data Migration & Cloud Modernization
- Contributed as part of the team that migrated a petabyte-scale, mission-critical on-premise Teradata data warehouse to Azure Synapse using the Datometry virtualization platform, reducing total cost of ownership by 60% and accelerating data accessibility for downstream analytics teams.
- Automated data pipeline and Azure deployment workflows using PowerShell, YAML, and Azure DevOps, applying Infrastructure-as-Code and CI/CD practices that cut deployment time from 90 minutes to under 25 minutes.
- Wrote Python scripts to automate data validation, reducing manual processing time by approximately 12–14 hours per week.
- Redesigned data models and optimized Azure resource allocation, improving average query performance by 25% and cutting monthly cloud costs by 45%.
Data Engineer / DevOps Engineer at Tata Consultancy Services (TCS) (2021-01 – Present)
Global Stakeholder Engagement & Onsite Consulting
- Worked onsite at ABN AMRO's Amsterdam office as primary technical point of contact for the on-prem-to-Azure migration, cutting average requirements-to-delivery turnaround from 4 weeks to 1 week.
- Built long-term client relationships through direct technical consultation and hands-on delivery leadership across 3 major engagements.
Education
Masters in Computer Science – Sastra University (2023-01)
Bachelor in Computer Science – Mumbai University (2021-01)

