Python Developer

Project Description:

VR-124755

• We have a robust, hands-on engineering culture dedicated to continuous learning, knowledge-sharing, technical skill development and networking. We are an essential part of the Bank’s technology platform and develop applications for many important business areas.
• Your initial project will be a core AI & Data platform, designed to provide a best in class environment for building, running and scaling AI solutions. The platform provides tools, services, frameworks and data so teams can focus on solving business problems, not rebuilding infrastructure.
• • Data Scientists building analytics, ML and GenAI solutions
• • Engineers and Developers integrating AI into applications and workflows
• • Business users consuming AI-enabled insights and services
• As a Senior Engineer, you will be responsible for managing or performing work across multiple areas of the bank's overall IT Platform/Infrastructure including analysis, development, and administration.
• Responsibilities:
• • Data Pipeline Development & Optimization: Design, develop, and optimize complex data pipelines using Python and PySpark/Apache Spark for large-scale data processing, transformation, and ingestion.
• • Workflow Orchestration: Implement and manage data workflows and dependencies using Apache Airflow to ensure efficient and reliable data delivery.
• • Containerization & Orchestration: Deploy and manage data engineering workloads and applications within containerized environments using Kubernetes, ensuring scalability, resilience, and efficient resource utilization.
• • CI/CD Implementation: Design and implement robust CI/CD pipelines for automated testing, deployment, and monitoring of data engineering solutions, promoting a culture of continuous delivery and quality.
• • Data Lake & Storage Management: Work with modern data lake technologies, including Apache Iceberg, for efficient data storage, versioning, and schema evolution.
• • Object Storage Integration: Utilize object storage solutions for managing and accessing large volumes of unstructured and semi-structured data.
• • Problem Solving: Proactively identify, diagnose, and resolve complex data-related issues, performance bottlenecks, and data quality challenges.
• • Collaboration & Mentorship: Collaborate effectively with cross-functional teams including data scientists, analysts, software engineers, and product managers. Potentially mentor junior data engineers, sharing knowledge and best practices.
• • Technical Leadership: Contribute to technical design discussions, propose innovative solutions, and drive the adoption of best practices within the data engineering team.
• • Documentation: Create and maintain comprehensive technical documentation for data pipelines, architectures, and processes.

• Mandatory Skills Description:
• • Strong Python knowledge
• • Familiarity with Apache Airflow, Apache Spark, Kubernetes
• • Understanding of AI concepts like LLM, Embeddings, Vectors, RAG, MCP, Agents
• • Java knowledge is a plus
• • Good communication and interpersonal skills

Languages: English: C1 Advanced