Daniyal Anwar
Data Engineer / Data Automation Specialist | Python Automation | Web Scraping | LLM Pipelines | QA Testing
Hire this person
Send a job offer directly to this candidate
About
Data Engineer and Automation Specialist with 3.5 years of hands-on experience and 100+ delivered projects building production-grade data extraction, ETL-style pipelines, and automation systems. Strong in Python, Playwright, Selenium, and Pandas, with deep experience handling dynamic, JavaScript-heavy, and authenticated websites at scale. Also bring 1+ year of QA testing experience (manual and automated) — which means my pipelines ship validated, stable, and bug-free.
Hands-on with integrating LLMs (Gemini, Llama, OpenRouter) into intelligent data workflows. Reliable, detail-oriented, and focused on clean, scalable results.
Experience
Data Engineer / Data Automation Specialist - Metaviz Software House - Lahore, Pakistan
(2023-07 - 2026-11)
- Delivered 100+ production data scraping and automation projects across e-commerce, real estate, directories, and marketplaces.
- Built and maintained Playwright and Selenium pipelines for JS-heavy and authenticated sites, including Amazon Seller Central and BigCommerce multi-store platforms.
- Designed end-to-end data workflows: extraction, cleaning, normalization, deduplication, validation, and delivery in client-ready formats (CSV, JSON, Excel, DB).
- Integrated LLMs (Gemini, OpenRouter, Llama) into pipelines for intelligent parsing, classification, and enrichment where regex-based extraction fails.
- Engineered custom automation bots — file monitors, schedulers, and alert agents — that replaced repetitive manual operations and run unattended.
- Added crash-resume, retry, and fallback logic to long-running scrapers to keep data collection reliable at scale.
- Delivered clean handoff documentation and ongoing maintenance as target sites evolved.
- QA Testing Responsibilities (1+ year, alongside data engineering)
- Performed manual and functional testing on client web platforms, finding and reporting bugs with clear steps, URLs, and screenshots.
- Tested mobile responsiveness and layout across devices, browsers, and screen sizes, catching UI and usability issues before release.
- Created and executed test cases and QA checklists covering core user flows, forms, navigation, and edge cases.
- Wrote automated test scripts in Python (Playwright) to cut repeat regression testing time.
- Collaborated with developers to reproduce, verify, and re-test fixes, improving release quality.
Education
Intermediate - I.Com - Government M.A.O College, Lahore (2022)
1-Year I.T Diploma - I.T - 2Brain College, Lahore (2021)
Matriculation - Trust Model Boys High School, Lahore (2020)
