Skip to main content
Daniyal Anwar

Daniyal Anwar

Data Engineer / Data Automation Specialist | Python Automation | Web Scraping | LLM Pipelines | QA Testing

Talent
LahoreMember since November 11, 2026
PandasRegexJSONCSVExcelData Extraction (ETL)Data CleaningNormalizationDeduplicationValidationPlaywrightSeleniumAnti-bot HandlingOpenRouterLlamaHugging FacePrompt EngineeringFunctional TestingRegression TestingJavaScript
·

Hire this person

Send a job offer directly to this candidate

PandasRegexJSONCSVExcel

About

Data Engineer and Automation Specialist with 3.5 years of hands-on experience and 100+ delivered projects building production-grade data extraction, ETL-style pipelines, and automation systems. Strong in Python, Playwright, Selenium, and Pandas, with deep experience handling dynamic, JavaScript-heavy, and authenticated websites at scale. Also bring 1+ year of QA testing experience (manual and automated) — which means my pipelines ship validated, stable, and bug-free.

Hands-on with integrating LLMs (Gemini, Llama, OpenRouter) into intelligent data workflows. Reliable, detail-oriented, and focused on clean, scalable results.

Experience

Data Engineer / Data Automation Specialist - Metaviz Software House - Lahore, Pakistan

(2023-07 - 2026-11)

  • Delivered 100+ production data scraping and automation projects across e-commerce, real estate, directories, and marketplaces.
  • Built and maintained Playwright and Selenium pipelines for JS-heavy and authenticated sites, including Amazon Seller Central and BigCommerce multi-store platforms.
  • Designed end-to-end data workflows: extraction, cleaning, normalization, deduplication, validation, and delivery in client-ready formats (CSV, JSON, Excel, DB).
  • Integrated LLMs (Gemini, OpenRouter, Llama) into pipelines for intelligent parsing, classification, and enrichment where regex-based extraction fails.
  • Engineered custom automation bots — file monitors, schedulers, and alert agents — that replaced repetitive manual operations and run unattended.
  • Added crash-resume, retry, and fallback logic to long-running scrapers to keep data collection reliable at scale.
  • Delivered clean handoff documentation and ongoing maintenance as target sites evolved.
  • QA Testing Responsibilities (1+ year, alongside data engineering)
  • Performed manual and functional testing on client web platforms, finding and reporting bugs with clear steps, URLs, and screenshots.
  • Tested mobile responsiveness and layout across devices, browsers, and screen sizes, catching UI and usability issues before release.
  • Created and executed test cases and QA checklists covering core user flows, forms, navigation, and edge cases.
  • Wrote automated test scripts in Python (Playwright) to cut repeat regression testing time.
  • Collaborated with developers to reproduce, verify, and re-test fixes, improving release quality.

Education

Intermediate - I.Com - Government M.A.O College, Lahore (2022)

1-Year I.T Diploma - I.T - 2Brain College, Lahore (2021)

Matriculation - Trust Model Boys High School, Lahore (2020)

Skills

Data Engineer / Data Automation SpecialistPython AutomationWeb ScrapingLLM PipelinesQA Testing

Reviews

Related