Sai Narendra Dasu
Web Scraping Engineer
Hire this person
Send a job offer directly to this candidate
About
Results-driven Web Scraping Engineer with 4+ years of experience in data extraction, web automation, and large-scale data integration. Proficient in Python, Selenium, Playwright, BeautifulSoup, and Scrapy, with expertise in handling dynamic websites, APIs, and complex HTML structures. Experienced in building scalable scraping pipelines, data cleaning, transformation, and exporting structured datasets for analytics and business intelligence.
Strong understanding of anti-bot mechanisms, session handling, and performance optimization. Passionate about delivering reliable, high-quality data solutions.
Experience
Data Indexing Programmer - LARVOL - REMOTE
(2024-02)
- Developed Python scripts to automate indexing of abstracts, speaker details, and session information from medical conference websites.
- Implemented parsing logic to structure HTML-based content into normalized datasets.
- Handled complex data hierarchies including tracks, sub-tracks, and session categorizations.
- Improved indexing efficiency by reducing manual intervention through automation workflows.
- Extracted and processed abstract content from PDF documents using Python-based parsing techniques.
- Designed automated pipelines to export processed data into Excel (.xlsx), CSV, and JSON formats.
- Collaborated with data and analytics teams to ensure accurate data mapping and schema alignment
Software Engineer(Web Scraping) - GMWare Pvt Ltd - Chandigarh
(2022-12 - 2024-01)
- Analyzed and reverse-engineered network traffic to identify hidden API endpoints for liquor product data from US-based retail stores.
- Extracted structured product information (pricing, availability, SKU, store location data, ratings, etc.) using REST APIs and JSON responses.
- Developed Python-based automation scripts to send authenticated API requests and handle dynamic tokens and headers.
- Implemented error handling, retry mechanisms, and rate-limit management for stable data collection.
Junior Data Extraction Engineer - TJ Green Energy Pvt Ltd - Coimbatore
(2021-12 - 2022-11)
- Assisted in extracting and indexing scientific session data, abstracts, and speaker information from medical conference platforms.
- Supported data collection and indexing activities under senior team guidance.
- Worked with Python scripts to gather and organize structured data.
- Helped in extracting content from PDF abstracts and formatting it properly.
- Followed data standards and guidelines to ensure consistency across datasets.
