
Milan Vadhadiya
Python Developer - Web Scraping and Automation
Hire this person
Send a job offer directly to this candidate
About
Python Developer with 6+ years of experience specializing in large-scale web scraping, anti-bot evasion, and intelligent automation. Expert in extracting structured data from modern web applications including Next.js and SPAs, and building high-volume scraping systems processing 1M to 2M+ records per day. Proven ability to reduce manual work by 80%+ through automation.
Strong expertise in Playwright, Scrapy, AWS, Docker, TLS fingerprinting, session management, and AI-assisted self-healing scrapers leveraging LLMs and agentic tools such as Claude and Cursor.
Experience
Senior Web Scraping Developer at Assured Health Technology Pvt. Ltd. (2024-05 – Present)
- Building automated systems for data extraction and form submission across government healthcare portals for licensing, enrollment, and credentialing workflows.
- Developed robust scraping workflows handling session-based authentication, dynamic content, and complex multi-step processes.
- Implemented anti-bot evasion strategies including TLS fingerprinting, user-agent spoofing, and cookie injection to maintain stable access to protected portals.
- Integrated LLM-based auto-healing logic and agentic AI tools (Claude, Cursor) to reduce scraper breakage and accelerate development cycles.
- Improved operational efficiency by automating repetitive manual processes, reducing manual work by 80%+.
Senior Web Scraping Developer at HireRight Background Screening India LLP (2023-05 – 2024-05)
- Built automated scrapers for US judicial and verification-related sites with strict anti-bot protections.
- Designed scalable scraping workflows ensuring timely delivery with limited resources.
- Implemented session management, scheduling, retry, and monitoring systems for high reliability.
- Applied user-agent rotation and request fingerprint randomization to avoid detection on high-security portals.
Senior Software Developer II at PromptCloud Technologies Pvt. Ltd. (2022-04 – 2023-01)
- Worked on large-scale e-commerce scraping projects with distributed crawling architectures.
- Used proxies, VPNs, and rotating fingerprints to handle IP blocking and anti-bot restrictions.
- Contributed to POCs for complex scraping challenges including JavaScript-heavy SPAs and protected APIs.
Python Developer - Web Scraping at X-byte Enterprise of Crawling (2020-03 – 2022-04)
- Built scrapers using Scrapy and Selenium across multiple domains including retail, real estate, and directories.
- Implemented proxy rotation, cookie injection, and anti-blocking strategies for high-reliability data extraction.
- Led team efforts, trained junior developers, and managed end-to-end project delivery.
Education
Bachelor of Technology in B.Tech – L.E. College (2013-06 – 2018-04)
