Big Data Developer

Job Title: Big Data Developer (Spark, Scala and Java)

Location: Toronto, ON (4 days onsite a week)

Duration: Long Term Contract

Job Description

Provide consulting services on new initiatives (small to large of varying complexity).

Explore new emerging technologies and how they best suit our applications

Develop, code, document, and execute unit tests, system, integration, and acceptance tests using different languages and testing tools for functions of high complexity.

Ensure adequate technical documentation and training.

Optimize spark jobs and java applications.

Architect, design, and implement solutions that meet the stakeholder’s needs

Participate actively in requirements gathering, data modeling, and design sessions

Prepare high-level and detailed technical specifications for the projects in accordance with PLC, security, and architecture documentation objectives

Develop detailed plans and accurate estimates for the completion of build, system testing, and implementation phases of a project

Develop, code, document, and execute unit tests, systems, integration and acceptance tests, and testing tools for functions of high complexity

Write, test, and maintain detailed programs according to specifications given by computer software engineers and systems analysts

Knowledge and Experience 7+ years of application development experience in Hadoop, Spark, and Java/Scala

2+ years of application development experience in Java and Spring Framework

7+ years of full development life cycle experience, from architecture through test and deployment and cross-platform skills

Experience leading a team of developers

What do you need to succeed?

Must Have Experience in developing and optimizing Big Data applications using Java/Scala and Spark on Cloudera/HDP.

Experience in building data pipelines

Experience in developing/designing micro-service architecture.

Experience in developing applications in Spring & Spring Boot

Working knowledge of Jenkins CI, Git, JIRA

Ability to seek improvements to all aspects of the development process

Nice to have Knowledge of Credit Risk Markets. Thanks & Regards,

Vignesh vignesh@themesoft.com