Tiparam Priyanka
GCP Data Engineer
Hire this person
Send a job offer directly to this candidate
About
GCP Data Engineer with 5 years of IT experience specializing in designing, developing, and supporting scalable data engineering solutions on Google Cloud Platform (GCP). Hands-on experience in building batch and streaming ETL/ELT pipelines using Python, PySpark, SQL, Dataflow, Dataproc, BigQuery, Cloud Composer (Airflow), Pub/Sub, and Cloud Storage (GCS). Skilled in data modeling, data validation, performance tuning, workflow orchestration, and cloud data migration.
Experienced in automating infrastructure using Terraform and implementing CI/CD pipelines with Git, Cloud Build, Docker, and Kubernetes. Strong knowledge of cloud monitoring, troubleshooting production data pipelines, and delivering reliable, secure, and high-performance data solutions in Agile environments. Proficient in integrating analytics platforms such as Tableau and Power BI to enable business reporting and data-driven decision-making.
Experience
GCP Data Engineer - VisionQuest Solution Pvt Ltd
(2022-08)
- Designed, developed, and maintained enterprise-scale Batch & Streaming ETL/ELT Pipelines using Python, PySpark, SQL, Dataflow, Dataproc, BigQuery, Cloud Composer (Airflow), Pub/Sub, and Google Cloud Storage (GCS)
- Built end-to-end Data Ingestion Frameworks to load data from RDBMS, APIs, Flat Files, Cloud Storage, and Streaming Sources into GCP
- Developed high-performance PySpark and Spark SQL applications for large-scale data transformation and processing
- Designed and optimized BigQuery objects including Partitioned Tables, Clustered Tables, Materialized Views, and Complex SQL Queries for high-performance analytics
- Developed and managed workflow orchestration using Cloud Composer (Apache Airflow) with Scheduling, Dependency Management, Retries, and SLA Monitoring
- Built Real-Time Streaming Pipelines using Pub/Sub, Dataflow, and Apache Beam for low-latency data processing
- Implemented Data Cleansing, Data Transformation, Data Enrichment, Deduplication, and Data Validation to ensure high-quality datasets
- Designed Data Warehouse Models including Star Schema, Snowflake Schema, Fact Tables, Dimension Tables, Surrogate Keys, and SCD Type-1 & Type-2
- Built Metadata-Driven ETL Frameworks to improve scalability, maintainability, and code reusability
- Implemented Data Quality Frameworks with Schema Validation, Reconciliation, Record Count Validation, Duplicate Detection, and Business Rule Validation
- Optimized Spark Jobs using Partitioning, Caching, Broadcast Joins, Memory Tuning, and Shuffle Optimization to improve performance
- Developed reusable Python Automation Scripts for API integration, file processing, data validation, and operational tasks. Worked extensively with Google Cloud Storage (GCS) for Data Staging, Archival, Lifecycle Management, and Secure Storage
- Automated cloud infrastructure provisioning using Terraform (Infrastructure as Code - IaC) with reusable modules
- Built automated CI/CD Pipelines using Git, Cloud Build, Docker, and Kubernetes for seamless deployment of data engineering applications
- Integrated enterprise data platforms with Tableau, Power BI, and Looker for analytics, dashboards, and business reporting
- Monitored production environments using Cloud Monitoring, Cloud Logging, Prometheus, and Grafana, ensuring High Availability and SLA Compliance
- Performed Root Cause Analysis (RCA) for Pipeline Failures, Data Issues, Performance Bottlenecks, and Production Incidents, implementing permanent fixes
- Processed multiple file formats including CSV, JSON, XML, Avro, ORC, and Parquet across enterprise data pipelines
- Implemented IAM Roles, Service Accounts, Secret Manager, Encryption, and Data Governance to secure enterprise data platforms
- Supported Cloud Migration Projects, modernizing legacy ETL applications into Cloud-Native GCP Data Platforms
Software Analyst - Teleperformance Global Services Pvt. Ltd.
(2021-03 - 2022-06)
Education
Master of Commerce - Commerce - Dewan Bahadur Padma Rao Mudaliar College For Women



