Med Amine

Research Crawling & Data Engineer at Deck (2025-08 – Present)

Architected distributed web crawlers with Playwright against JavaScript-heavy, bot-protected government and enterprise targets, pairing proxy rotation with browser fingerprint spoofing to sustain high uptime across millions of daily requests.
Engineered Claude API-powered autonomous agents to run end-to-end scraping workflows, extraction scheduling, parsing, quality flagging, and report generation, cutting manual review effort 60–70%.
Served as primary technical liaison for 5+ enterprise clients, scoping data-collection requirements and translating pipeline output into decisions for research and modeling teams.
Documented and migrated client onboarding workflows into standardized implementation guides, reducing onboarding friction and time-to-value.
Built custom connectors integrating scraped data with BigQuery and S3, consolidating multi-source web data into unified, query-ready warehouses.
Implemented automated data quality checks and schema-drift alerts, catching crawl failures before they hit client dashboards.
Reverse engineered complex web applications by analyzing browser traffic, HTTP requests/responses, cookies, authentication flows, and proxy routing to build resilient data acquisition pipelines for JavaScript-heavy websites.

Data Engineer & Tech Lead at Gravity Bytes (2023-09 – 2025-07)

Built a scraping platform for e-commerce websites from the ground up, combining a custom scheduler, proxy pool, and browser pool to run Playwright- and requests-based automation at scale.
Architected Kafka- and Redis-backed messaging with SQS for job distribution, decoupling scraper workers from downstream processing and lifting throughput 40%.
Built data validation and schema/quality versioning frameworks, achieving zero data-related escalations across 2 years of production.
Deployed Prometheus and Grafana for pipeline monitoring and alerting, catching failures before they reached downstream ML workflows.
Built asynchronous Python crawling services using async/await concurrency patterns, Kafka, Redis, and SQS to execute large-scale distributed workloads with improved throughput and fault tolerance.
Led a 3-engineer team through sprints, code review, and stakeholder delivery, integrating REST APIs and Kafka to cut end-to-end latency 20%.

Data Engineer at Wiser Solutions (2022-07 – 2023-08)

Engineered ETL pipelines processing 10M+ daily records from e-commerce platforms (Amazon, eBay), delivering high-quality integrated datasets for client analytics.
Built production-grade scrapers with custom error-handling middleware and schema validation, ensuring robust extraction from dynamic marketplace sources.
Built Flask-based APIs and PostgreSQL backends powering real-time analytics dashboards, improving SLA adherence 15% through custom orchestration logic.
Delivered machine learning-ready data marts in Redshift, supporting model development and business reporting with clean, structured, deduplicated datasets.

About