Med Amine

Crawling & Data Engineer with hands-on experience building production web data acquisition systems for enterprise clients. Deep expertise in distributed data acquisition systems, crawler architecture, asynchronous processing, browser automation, reverse engineering modern web applications, and resilient backend data pipelines. Delivered zero data-related escalations across 2 years of production environments.

Proven track record shipping AI-powered scraping agents, client-facing tooling, and fault-tolerant infrastructure in lean, execution-focused teams.

Research Crawling & Data Engineer at Deck (2025-08 – Present)

• Architected distributed web crawlers with Playwright against JavaScript-heavy, bot-protected government and enterprise targets, pairing proxy rotation with browser fingerprint spoofing to sustain high uptime across millions of daily requests.
• Engineered Claude API-powered autonomous agents to run end-to-end scraping workflows, extraction scheduling, parsing, quality flagging, and report generation, cutting manual review effort 60–70%.
• Served as primary technical liaison for 5+ enterprise clients, scoping data-collection requirements and translating pipeline output into decisions for research and modeling teams.
• Documented and migrated client onboarding workflows into standardized implementation guides, reducing onboarding friction and time-to-value.
• Built custom connectors integrating scraped data with BigQuery and S3, consolidating multi-source web data into unified, query-ready warehouses.
• Implemented automated data quality checks and schema-drift alerts, catching crawl failures before they hit client dashboards.
• Reverse engineered complex web applications by analyzing browser traffic, HTTP requests/responses, cookies, authentication flows, and proxy routing to build resilient data acquisition pipelines for JavaScript-heavy websites.

Data Engineer & Tech Lead at Gravity Bytes (2023-09 – 2025-07)

• Built a scraping platform for e-commerce websites from the ground up, combining a custom scheduler, proxy pool, and browser pool to run Playwright- and requests-based automation at scale.
• Architected Kafka- and Redis-backed messaging with SQS for job distribution, decoupling scraper workers from downstream processing and lifting throughput 40%.
• Built data validation and schema/quality versioning frameworks, achieving zero data-related escalations across 2 years of production.
• Deployed Prometheus and Grafana for pipeline monitoring and alerting, catching failures before they reached downstream ML workflows.
• Built asynchronous Python crawling services using async/await concurrency patterns, Kafka, Redis, and SQS to execute large-scale distributed workloads with improved throughput and fault tolerance.
• Led a 3-engineer team through sprints, code review, and stakeholder delivery, integrating REST APIs and Kafka to cut end-to-end latency 20%.

Data Engineer at Wiser Solutions (2022-07 – 2023-08)

• Engineered ETL pipelines processing 10M+ daily records from e-commerce platforms (Amazon, eBay), delivering high-quality integrated datasets for client analytics.
• Built production-grade scrapers with custom error-handling middleware and schema validation, ensuring robust extraction from dynamic marketplace sources.
• Built Flask-based APIs and PostgreSQL backends powering real-time analytics dashboards, improving SLA adherence 15% through custom orchestration logic.
• Delivered machine learning-ready data marts in Redshift, supporting model development and business reporting with clean, structured, deduplicated datasets.

Bachelor of Science in Computer Science – Higher Institute of Information and Communication Technologies (2017-09 – 2020-06)