Pooja
Prod Compliance Associate Sr.
Talent
DelhiMember since May 24, 2026
Evaluation Frameworks & Gold-Label DatasetsPython
·
Hire this person
Send a job offer directly to this candidate
Evaluation Frameworks & Gold-Label DatasetsPython
About
Proven track record in AI red teaming and adversarial testing, with deep expertise in risk analysis and compliance management. Demonstrated ability to drive process improvements and enhance operational efficiency through innovative workflow design.
Experience
Prod Compliance Associate Sr. at Amazon (2024-05 – Present)
- Led AI red teaming, LLM evaluations, and adversarial testing across multiple AI tools, contributing to evaluation frameworks, gold-label datasets, reviewer workflows, and quality metrics.
- Served as SME and led a team of 26 analysts, partnering with Product, Engineering, Operations, and Policy teams to design AI-augmented workflows, support workflow integrations and API-enabled solutions, and improve automation, compliance, and operational efficiency.
- Designed and evaluated prompt strategies, agent behaviors, and human-in-the-loop review workflows using Python-based analysis, performance metrics, and reviewer feedback to improve model reliability, consistency, and decision quality.
Content Risk Analyst at Amazon (2022-10 – 2024-02)
- Conducted risk assessments, compliance investigations, and quality reviews across large-scale operational workflows using AI-powered tools and internal systems.
- Collaborated with cross-functional teams to improve processes, develop operational controls, author SOPs and playbooks, and support tooling and workflow enhancements.
Advisor 1 at Concentrix Daksh (2020-08 – 2022-07)
- Reviewed and enforced content moderation policies for a major social media platform while analyzing abuse trends, policy gaps, and enforcement consistency.
- Supported policy refinement, reviewer training, documentation, and workflow improvement initiatives in collaboration with Policy, Quality, and Operations teams.
Education
Bachelor's in Computer Applications in Computer Engineering in Computer Engineering – Guru Gobind Singh Indraprastha University (2020-08 – 2022-07)
Senior Secondary Education in Science in Science – Kendriya Vidhyalaya (2017-03)
Skills
Prod Compliance Associate Sr.