Skip to main content

Data Engineer - Google Cloud Platform

Technology
ProPhecy Technologies
1 month ago

Job description

Role Overview :

The GCP Engineer will be responsible for designing, building, and operating scalable cloud-native data platforms on Google Cloud Platform. The role focuses on Big Query-based analytics, workflow orchestration, infrastructure automation, and containerized deployments using modern data engineering practices.

Key Responsibilities :

  • Design, develop, and optimize BigQuery datasets, tables, views, and SQL queries.
  • Build and manage data transformation pipelines using DBT.
  • Develop and maintain Cloud Composer (Apache Airflow) DAGs.
  • Provision and manage GCP infrastructure using Terraform.
  • Develop and manage containerized workloads using Docker.
  • Implement CI/CD pipelines for data and infrastructure deployments.
  • Ensure data quality, governance, security, and cost optimization.
  • Monitor pipelines and troubleshoot production issues.

Required Skills & Experience:

  • Strong hands-on experience with Google Cloud Platform (GCP).
  • Advanced BigQuery SQL and performance optimization.
  • Terraform for Infrastructure as Code.
  • Cloud Composer / Apache Airflow.
  • dbt (models, tests, snapshots, documentation).
  • Docker and containerized environments.
  • Good Python and SQL skills.

Skill Requirements:

  • Proficiency in Google BigQuery for data warehousing and analytics.
  • Strong SQL skills for querying and managing large datasets.
  • Advanced knowledge of Python programming language for data manipulation and analysis.
  • Experience with Google Dataflow for real-time data processing and ETL pipelines.
  • Strong problem-solving and analytical skills.
  • Excellent communication and leadership abilities to effectively lead a technical team.
Keywords
OrchestrationApache AirflowAirflowPythonSqlApache LicenseApache Http ServerCI/CDBigQuery

Interested in this role?