Junior Data Engineer

A global leader in technology services, helping clients transform and innovate across North America, Europe, and Asia, is seeking a talented individual to join their dynamic team. This organization empowers businesses to leverage cutting-edge solutions and drive meaningful change.

The Role

• Develop and support Spark-based processing pipelines using PySpark and Python in a Hadoop environment.
• Design, develop, and maintain real-time streaming pipelines with Kafka, Spark Streaming, and Flink.
• Lead the migration of on-premise data and workloads to Google Cloud Platform (GCP).
• Work extensively with GCP Data Services including BigQuery, Cloud Composer, Data Proc, and Cloud Storage.
• Translate business requirements into robust technical designs and execute integration and production deployments.
• Collaborate closely with internal teams, architects, and stakeholders to ensure platform enablement and modernization.

What You'll Need

• 3+ years of hands-on experience in Data Engineering, including Hadoop and GCP Data Solutions.
• Proven experience with GCP Data Services like BigQuery, Cloud Storage, Data Proc, and Cloud Composer.
• At least 2 years of experience with real-time processing technologies such as Kafka, Flink, and Spark Streaming.
• 3+ years of experience with data lake concepts and Python for data manipulation.
• Strong ability to independently convert requirements into scalable technical designs and perform deployments.
• Familiarity with enterprise change-management and access-management procedures.

What's On Offer

• Opportunity to work on a large-scale data migration and modernization project to GCP.
• Exposure to both established Hadoop and new GCP data platform environments.
• Competitive compensation and a comprehensive benefits package.
• A collaborative team setting where you can make a significant impact.

Apply via Haystack today!