Pranav Aggarwal

I am a CS undergraduate with a background in backend engineering and RLHF. Through my work at Protocol Labs and Scale AI, I realized that making systems scale is different from making them safe. I have experience building AI agents and distributed systems, and I am now also going towards research. I want to figure out why models fail and how to evaluate them properly, rather than just building applications on top of them.

AI Evaluator & RLHF Contributor - Alignerr

(2025-12)

• Conducted targeted evaluation of Large Language Models through specialized RLHF workflows and complex prompting tasks.
• Assessed model reasoning and output quality to enhance accuracy and reduce hallucinations across specialized datasets.

PLDG Cohort 2 Contributor - Protocol Labs

(2026-01)

• Contributing to the Storacha team (formerly web3.storage) to improve decentralized hot storage layers. Working with IPFS and Filecoin protocols to optimize data retrieval and reliability in distributed systems.
• Working with large-scale distributed architectures to ensure data persistence and availability.

AI Data & RLHF Expert - Deccan AI

(2025-06)

• Conducting high-quality data annotation and model evaluation to refine Large Language Model performance.
• Analyzing model failures in reasoning, coding tasks to give granular feedback for reinforcement learning pipelines.

AI Data & RLHF Expert - Scale AI

(2024-08 - 2024-12)

• Evaluated LLM responses for safety, factual accuracy, and instruction adherence to support RLHF workflows.
• Designed adversarial prompts ("jailbreaks") to stress-test model guardrails and identify safety vulnerabilities.
• Ranked model outputs based on reasoning quality, helping to reduce hallucinations in downstream model versions.

Software Engineering Intern - Dukaan

(2024-08 - 2024-12)

• Engineered a customer support AI agent, reducing response latency by 4x via real-time HTTP streaming.
• Implemented automated CI/CD pipelines (GitHub Actions, Docker) to catch regressions in model behavior before production.

Bachelor's degree - Computer Science - Birla Institute of Technology and Science, Pilani (2023-07 - 2026-07)

Secondary School - Birla School, Pilani (2019-05 - 2021-06)