Skip to main content

TCS - Data Engineer - Google Cloud Platform

Technology
TCS
2 days ago

Job description

Job Description :

Key Responsibilities :

  • Design, develop, and maintain scalable data pipelines and data processing frameworks on GCP.
  • Build and optimize ETL/ELT workflows to ingest, transform, and load data from multiple sources.
  • Develop and manage enterprise-scale data lakes, data warehouses, and lakehouse architectures.
  • Implement batch and real-time data processing solutions.
  • Ensure data quality, integrity, security, and governance across the data lifecycle.
  • Work closely with data architects, analytics teams, data scientists, and business stakeholders to deliver reliable data solutions.
  • Optimize BigQuery environments for performance and cost efficiency.
  • Monitor data pipelines, troubleshoot issues, and ensure SLA compliance.
  • Automate deployment and operational processes using DevOps and Infrastructure-as-Code practices.
  • Support AI/ML initiatives by building and maintaining data platforms for analytics and model training.

GCP Data Services :

  • BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, BigLake, Dataplex, Cloud Composer, Cloud SQL, Bigtable, Spanner

Data Engineering :

  • Data Pipeline Development, ETL / ELT Processing, Data Warehousing, Data Lake Architecture, Data Modeling, Batch Processing, Stream Processing, Data Migration, Workflow Orchestration

Big Data Technologies :

  • Apache Spark, Apache Beam, Hadoop Ecosystem, Kafka, Dataflow Streaming, Dataproc Clusters
Keywords
OrchestrationApache HadoopApache KafkaApache BeamApache SparkDevOpsSqlHadoopApache Http ServerBig dataData managementBigtableBigQuery

Interested in this role?