Lead Big Data Developer (Java / Spark / Scala)

• *Job Overview**

We are seeking a seasoned Lead Big Data Developer to drive high-complexity initiatives and technical innovation. In this role, you will act as a consultant and architect, designing robust data solutions and optimizing high-performance applications. You will be responsible for the full software development life cycle (SDLC), from initial requirements gathering and data modeling to final implementation and team leadership.

• *Key Responsibilities
• *1. Architecture & Strategic Consulting
• Solution Design: Architect, design, and implement end-to-end solutions that meet complex stakeholder needs.
• Innovation: Explore emerging technologies and assess their suitability for existing and future applications.
• Consulting: Provide technical consulting for initiatives ranging from small-scale tasks to large, multi-faceted projects.
• Data Modeling: Participate actively in requirements gathering, data modeling, and collaborative design sessions.
• *2. Engineering & Optimization
• High-Complexity Coding: Write, test, and maintain detailed programs according to complex specifications.
• Performance Tuning: Optimize Spark jobs and Java applications to ensure maximum efficiency and scalability.
• Data Pipelines: Build and manage robust data pipelines and microservice architectures.
• CI/CD Integration: Work within an Agile environment using Jenkins CI, Git, and JIRA to ensure continuous improvement of the development process.
• *3. Planning & Documentation
• Technical Specifications: Prepare high-level and detailed technical specifications in alignment with security, architecture, and Project Life Cycle (PLC) objectives.
• Estimation & Planning: Develop detailed project plans and provide accurate estimates for build, testing, and implementation phases.
• Documentation: Ensure all technical documentation and training materials are comprehensive and up-to-date.
• *4. Quality Assurance & Leadership
• Comprehensive Testing: Develop and execute unit, system, integration, and acceptance tests for high-complexity functions.
• Team Leadership: Lead and mentor a team of developers, fostering a culture of technical excellence and continuous improvement.
• *Qualifications & Experience
• *Must-Have Requirements:
• 7+ years of professional application development experience in Hadoop, Spark, and Java/Scala.
• 7+ years of full software development life cycle (SDLC) experience, from architecture through to deployment.
• 2+ years of specific experience with Java and the Spring Framework (including Spring Boot).
• Proven experience in developing and optimizing Big Data applications on Cloudera/HDP.
• Strong background in Microservice Architecture and building scalable Data Pipelines.
• Experience leading a team of developers in a professional environment.
• Deep knowledge of Jenkins, Git, and JIRA.
• *Nice-to-Have Requirements:
• Domain knowledge of Credit Risk Markets.
• Experience with cross-platform development and multi-language testing tools.

Job Type: Full-time

Pay: $70.00-$75.00 per hour

Expected hours: 40 per week

Work Location: Hybrid remote in Toronto, ON (Toronto District)