Josh

Senior Python Engineer with 6+ years of experience building scalable web scraping platforms, automation systems, and data-driven applications across recruitment, logistics, and retail industries. Specialized in Python, Playwright, Selenium, FastAPI, AI-powered enrichment workflows, and large-scale data pipelines, with hands-on experience handling millions of records and high-throughput distributed scraping systems.

Software Engineer at Kitchify (2026-04 – Present)

• Built and maintained core backend features for order guides, restaurant–vendor associations, and admin tooling using a PHP/MySQL/MongoDB stack.
• Designed and implemented EDI integrations with major foodservice distributors (e.g. Sysco, US Foods, PFG, GFS, Shamrock, Ben E. Keith), generating X12/CSV/TXT order files and delivering them through FTP/SFTP.
• Developed Python ETL pipelines and parsers to ingest vendor catalogs from emails, spreadsheets, and scraped feeds, normalizing pricing, SKUs, and product data into the platform catalog.
• Extended inbound EDI workflows for order acknowledgments and invoices, improving order visibility and reducing manual reconciliation efforts.
• Collaborated with operations and vendor IT teams to onboard new distributors, configure account credentials, and validate production order submissions.

Senior Python Developer at Jobbyo (2024-01 – 2026-04)

• Architected a large-scale web scraping platform covering 40+ job platforms, implementing purpose-built scrapers using Selenium, Playwright, Scrapy, and Requests matched to each target site's structure, handling dynamic rendering, authentication flows, and anti-bot measures across diverse source types.
• Engineered high-performance scraping pipelines with multithreading, adaptive rate limiting, and automated retry logic, processing large volumes of job listings continuously across sources while maintaining data freshness and minimising source-side disruption.
• Built real-time scraper observability dashboards in Metabase tracking job coverage rates, ingestion speed, deduplication accuracy, and scraper health indicators, enabling fast issue detection and data-driven decisions on pipeline prioritisation.
• Integrated Sentry for advanced error tracking & alerting across the scraping infrastructure, capturing failure patterns per source and significantly reducing mean time to resolution for pipeline and processing issues.
• Streamlined scraper deployment and operations using GitHub Actions for CI/CD, Docker for containerisation, and Dozzle for centralised real-time log streaming, enabling reliable and repeatable deployments with minimal manual intervention.

Python Developer at OptimHire (2021-10 – 2023-11)

• Designed and maintained a large-scale Job Application Tracking System (ATS) handling over 35M job listings and automating data collection across 40+ job platforms.
• Built high-performance Python crawlers and automation bots using Playwright, Selenium, and Requests, implementing multi-threading, async execution, and proxy rotation for stable, high-throughput scraping.
• Developed web automation scripts for autofilling and submitting job applications, handling CAPTCHA, Cloudflare, and Akamai challenges through adaptive browser behavior and smart retries.
• Implemented robust data pipelines and scheduling systems for continuous scraping, data refresh, and validation, ensuring consistent uptime and reliable updates.
• Optimized MongoDB and PostgreSQL workflows for performance and scalability, improving query efficiency and reducing data duplication and latency.
• Integrated backend modules to generate enriched, standardized, and AI-optimized job descriptions, improving data quality and automation coverage.

Junior Software Developer at Gleent, Inc. (2020-08 – 2021-08)

• Developed and maintained software applications by writing clean, efficient code, fixing bugs, and delivering feature enhancements across development and production environments.
• Assisted with automation workflows by creating scripts and API integrations to streamline data processing, improve system efficiency, and reduce manual operations.
• Supported cloud-based applications and infrastructure by monitoring services, troubleshooting technical issues, and collaborating with senior engineers to improve system reliability.
• Worked with databases, backend services, and application servers to optimize performance, resolve production issues, and ensure stable application operations.
• Participated in Agile development processes, including code reviews, testing, deployments, and debugging, while following software development best practices and version control workflows.

Bachelor's degree in Computer Science – University of the East (2017 – 2020)