Shreyas Singh

AI Engineer with 4+ years of experience building production AI infrastructure, specializing in workflow execution, LLM model orchestration, and agentic systems. Architected systems processing 1.5M+ workflows and supporting 120+ models across 10+ providers, with experience designing distributed execution, tool calling, and fault-tolerant AI workloads. Seeking an AI/backend engineering role building production-scale LLM infrastructure and agent systems.

SDE 1 – SDE 2, Backend at Pepper Inc. (2023-10 – Present)

• Architected and built the execution infrastructure for Pepper's no-code AI workflow platform, processing 1.5M+ workflows across multi-step LLM, media, and integration tasks with concurrent node execution and chained workflow pipelines across hundreds of inputs in Sheets. [pepper.inc/blog/workflows]
• Designed distributed workflow execution using BullMQ and Redis-backed workers, with node-level retries, explicit error paths, optimistic state locking, persistent execution state, and stale-run recovery for fault-tolerant execution.
• Built a vendor-agnostic AI model abstraction layer supporting 120+ models across 10+ providers, standardizing request/response formats, errors, retries, usage reporting, authentication, and multi-modal execution while preserving provider-specific parameters, enabling new models and providers to be onboarded without changes to downstream workflow logic.
• Built agentic AI systems including a conversational copilot for the no-code workflow builder and an agent runtime supporting multi-turn conversations and iterative tool calling.
• Reduced backend bug-resolution time by 50% through structured error codes, categorized failure handling, and standardized debugging patterns.

Software Engineer – Senior Software Engineer at Yellow.ai (2022-02 – 2023-10)

• Worked directly with enterprise customers to translate business requirements and conversational use cases into production-ready AI chatbot implementations, owning delivery from requirements through deployment.
• Designed and delivered production AI-driven chatbots for enterprise customers across aviation, banking, and technology sectors in India and the UAE.
• Delivered multiple complex and time-sensitive enterprise AI projects, earning the Spotlight Award for ownership and quality of execution.
• Automated end-to-end chatbot testing using Python and Selenium, reducing manual QA effort by approximately 80% and improving release reliability.
• Mentored junior engineers and interns on technical implementation and production delivery.

B.Tech. in Information Technology – Institute of Engineering and Technology, Lucknow (2021)