Skip to main content

Senior Python & Machine Learning Operations Engineer

Technology
1 week ago

Job description

We are seeking a knowledgeable Senior Python/ML Operations Engineer with advanced Python and Flask, Large Language Models, Open API engineering, Containerization and Swagger expertise for a multi-year engagement to work with a foremost Healthcare IT Solutions Group in their Innovations Project Team.

Prerequisites for the selection of the Consultant encompass:

  • Advanced Python programming for back-end development for Machine Learning Operations.

  • Expertise with OpenAPI specs.

  • Conversant with LLMs, specifically Llama 2 or Mistral.

  • Required to productionize Large Language Model (LLM) based solutions.

  • Capable of taking an open-source Large Language Model (LLM) and fine tuning it to reflect custom data and retrieve data from a Vector database.

  • Will be required to design a RESTful API that interfaces with a Large Language Model (LLM) and can be used for user consumption.

  • Write Helm charts and the web front end.

  • Must be skilled in modularizing machine learning code.

  • Will transform Data Scientists' models into scalable, maintainable systems.

  • Integrate the APIs with MongoDB (Reddis, Vector, databases, embedding models).

  • Should have expertise in deploying and managing containerized applications using Kubernetes.

  • Ability to take an open-source hugging face model and productionalize it so that user can use it on custom data.

  • Plan the builds with Swagger CodeGen, Editor and Inspector.

  • Experience with Jupyter notebooks, Flask, FastAPI, and on premises Docker and Kubernetes.

  • Angular and Node are also utilized in this environment.

  • Document plan and steps for development.

Background Check :Yes

Interested in this role?