AI Software Engineer (Java & Python)

Position: AI Software Engineer (Java & Python)

Location: Hybrid (4days/week)- Toronto, ON

Job type: Full-Time/Permanent Hiring

We are seeking an experienced AI Software Engineer with a minimum of 6–8 years of experience and strong Java and Python skills to build and productionize secure, scalable Generative AI, LLM, RAG, and agentic AI solutions within a regulated banking environment.

Key Responsibilities

• Design, develop, test, deploy, and support AI-enabled enterprise applications using Java and Python.
• Build Generative AI solutions including RAG, conversational assistants, enterprise search, summarization, and workflow automation.
• Develop agentic AI capabilities using tool/function calling, orchestration, guardrails, and human-in-the-loop controls.
• Integrate LLMs, APIs, vector databases, enterprise data sources, and existing applications.
• Build scalable REST APIs and microservices using modern Java and Python frameworks.
• Implement prompt engineering, embeddings, document chunking, retrieval, reranking, and grounded response generation.
• Develop AI evaluation and regression frameworks covering accuracy, groundedness, safety, latency, reliability, and cost.
• Apply MLOps/LLMOps, including CI/CD, containerization, version control, monitoring, and production support.
• Apply enterprise security, privacy, IAM, responsible AI, and model-risk controls.
• Collaborate with business, product, architecture, data, security, and engineering teams to take AI use cases from prototype to production.
• Participate in code reviews, troubleshooting, technical documentation, and engineering mentorship.

Required Skills

• Strong hands-on Java and Python development.
• Experience building Generative AI / LLM applications.
• Strong experience with RAG, embeddings, vector search, retrieval, and prompt engineering.
• Experience with Agentic AI, tool/function calling, and orchestration.
• Strong REST API and microservices development experience.
• Experience integrating LLMs with enterprise applications and data sources.
• Knowledge of AI evaluation, testing, LLMOps/MLOps, CI/CD, and production monitoring.
• Understanding of enterprise security, privacy, and responsible AI practices.

Preferred Skills

• Azure OpenAI, Azure AI Search, or other cloud AI platforms.
• LangChain, LlamaIndex, Semantic Kernel, or similar frameworks.
• Vector databases and enterprise knowledge platforms.
• Model Context Protocol (MCP) and multi-agent orchestration.
• AI governance, content safety, and model-risk controls.
• Banking or financial services experience.
• GitHub Copilot or other AI-assisted development tools.