Scraper Control Board

Worker:
Last refresh:
Auto-refresh every 10s
ℹ️ How this works
Buttons
▶ Start All Queue all enabled stores that haven't been scraped yet. The daemon picks them up sequentially — one store at a time.
■ Stop Send a stop signal. The daemon finishes the current store, then halts cleanly. No stores are skipped mid-scrape.
↺ Retry Failed Re-queue only stores that failed in the previous run. Useful after fixing a transient error without re-scraping everything.
⟳ Reset All Reset all store statuses back to "Not Processed" and start a full fresh scrape from the beginning.
⚡ Recover Only appears when status is Stale. Clears a stuck session caused by a crashed daemon so you can start fresh.
How it works
Daemon required. Each chain needs a scraper process running on a server. The daemon polls this Worker every 15 seconds for commands. If no daemon is running for a chain, commands queue up but nothing executes.

Aldi & IGA — daemon runs on Oracle 158.178.138.248 via pm2.
Coles & Woolworths — daemon not yet started. Start it on a server to enable scraping.

Status meanings: Running = actively scraping · Idle = daemon polling, awaiting command · Stale = daemon crashed, session stuck.
Chain Status
Loading sessions…
Store Lists
Operation Log
Output
— Board logs appear here —