Pet Market Scout

2024 - Present

Overview

I built Pet Market Scout as a real-time web-scraping and alerting platform for the exotic pet community. The system continuously scans over 15 leading reptile and arachnid marketplaces, including MorphMarket, Josh’s Frogs, and Fear Not Tarantulas, checking for new listings every 30 minutes.

When a species of interest appears, users receive timely notifications, helping them connect with trusted sellers before rare species disappear from the market. The project combines data aggregation, automation, and community trust into a streamlined tool for enthusiasts and breeders alike.

SiteRepoDesign

Tech Stack

TypescriptTypescript
ReactReact
Node.jsNode.js
awsaws
UbuntuUbuntu
CursorCursor
FigmaFigma

Gallery

/images/pet-market-scout/1.png

Problem

Onboarding new seller sites was inconsistent and time-consuming, as each marketplace appeared to have its own approach to search and pagination. Without a standardized process, every integration required significant custom work.

Solution

Through analyzing multiple integrations, I identified recurring patterns that most seller sites followed. I abstracted these into three reusable approaches: a Puppeteer-based pattern for Shopify sites (the most common), a direct API extraction method (preferred when available), and a single-page parser for sites without pagination. These generic components allowed me to quickly plug new sellers into the system, with most sites falling neatly into one of the three categories. As a result, adding a new seller dropped from a complex task to a process that could be completed in under 10 minutes for some sites.