Data Engineer (Java/Python & Kafka)

Primary Skills

Data Engineer with Python, PySpark & Kafka

OR

Java Developer with Springboot, Spark & Kafka

Years of experience

6-8 Years

Availability to Join

Immediate ONLY

Job Description

Job Summary

CGI is looking for a skilled and proactive Data Engineer with hands-on experience in Kafka streaming, Apache Spark.

The ideal candidate will play a key role in designing, developing, and deploying scalable backend systems and real-time data pipelines.

This position is ideal for someone passionate about building high-performance systems and working with cutting-edge technologies in cloud-native environments.

Key Responsibilities

Develop real-time data streaming applications using Apache Kafka and Kafka Streams.

Build and optimize large-scale batch and stream processing pipelines with Apache Spark.

Containerize applications and manage deployments using Kubernetes.

Collaborate with DevOps teams to ensure CI/CD pipelines are robust and scalable.

Write unit tests and conduct code reviews to maintain code quality and reliability.

Troubleshoot and debug production issues across multiple environments.

Required qualifications to be successful in this role

Strong programming skills in Python/Java.

Hands-on experience with Apache Kafka, Kafka Streams, and event-driven architecture.

Solid knowledge of Apache Spark (batch and streaming).

Familiarity with microservices architecture, RESTful APIs, and distributed systems.

Experience with build tools such as Maven or Gradle.

Familiar with Git, Jenkins, CI/CD pipelines, and Agile development practices.

Excellent problem-solving skills and ability to work in a fast-paced environment.

Education

Bachelors or Masters degree in Computer Science, Engineering, or related field.

Location

Hyderabad (ONLY)

Shifts & Mode of Work

General Shifts, Initial 8 weeks WFO, Later Hybrid