Skip to main content

Mid-Level Google Cloud Platform Data Engineer

Technology
Haystack
Phoenix, United States2 months ago
Full time

Job description

This rapidly growing global leader in technology services and talent solutions, with a strong presence across North America, Europe, and Asia, is seeking a talented individual to join their team. They partner with clients to activate ideas and solutions, driving business transformation for a diverse portfolio of over 6,000 clients, including many Fortune 500 companies.

The Role

  • Develop and maintain data pipelines using Spark, PySpark, Python, and Kafka
  • Design and implement real-time streaming solutions with Spark Streaming and Flink
  • Migrate on-prem data and workloads to Google Cloud Platform (GCP)
  • Work extensively with GCP services such as BigQuery, Cloud Composer, Data Proc, and Cloud Storage
  • Translate technical requirements into architecture, design, and deployment deliverables
  • Collaborate with internal teams, architects, and stakeholders to support platform enablement

What You'll Need

  • 3+ years of experience in Data Engineering, including hands-on experience with Hadoop and Google Cloud Data Solutions
  • Proficiency with GCP Data Services: BigQuery, Cloud Storage, Data Proc, Cloud Composer
  • Experience with migrating data from on-prem environments to GCP
  • 2+ years of real-time processing experience using Kafka, Flink, and Spark Streaming
  • 3+ years of experience with data lakes and Python development
  • Ability to convert requirements into scalable technical designs and perform production deployments

What's On Offer

  • Opportunity to work on a large-scale migration project to GCP
  • Exposure to cutting-edge data engineering technologies
  • A collaborative team setting focused on innovation and modernization
  • Competitive hourly compensation package
Apply via Haystack today!

Keywords
monthsOfExperience: 36Apache KafkaApache HadoopApache SparkPythonHadoopBig dataBigQuery

Interested in this role?