Skip to main content

Distributed Data Processing Developer

Technology
Capgemini
Winnipeg, Canada6 days agoUntil 2026-12-11

Job description

Design distributed data processing applications with Apache Spark and Java, combining scalable architecture, efficient code, and strong SQL skills.

This Spark Developer role supports high-performance data solutions from development through production troubleshooting.

Responsibilities include reusable Java coding, Spark optimization, data quality, and collaboration with technical and business teams. Required technologies include relational databases, REST APIs, microservices, Git, and CI/CD processes.

Key Responsibilities

Collaborate with teams to gather data solution requirements

Develop applications using Apache Spark and Java

Optimize jobs for performance and memory management

Troubleshoot production issues and improve application performance

Implement scalable, reliable data processing solutions

Requirements

At least four years of software development experience

At least two years developing Spark and Java applications

Strong SQL and relational database capabilities

Knowledge of REST APIs and microservices architecture

Experience with Git and CI/CD processes

Use distributed computing, Spark optimization, Java development, and SQL expertise to deliver dependable large-scale data applications.

Interested in this role?