Webhooks
Signed callbacks on run start, completion and failure, with replay for anything your endpoint missed.
For teams that would rather react than poll. BatScrape posts a signed payload to your endpoint when a run changes state.
Signing
Every request carries an X-BatScrape-Signature header: an HMAC-SHA256 of the
raw body, keyed with the secret shown once when you create the endpoint. Verify
against the raw bytes, before parsing — a JSON round-trip will not match.
Delivery
Failed deliveries retry with exponential backoff for 24 hours. Anything still undelivered after that stays queued for manual replay for seven days, so an endpoint outage costs you a redelivery rather than a re-run.
What you need
An HTTPS endpoint that answers within 10 seconds. Answer fast and do the work asynchronously; BatScrape treats a slow 200 the same as a timeout.
Ready to stop babysitting scrapers?
When no scraper exists for your source, BatScrape ships one.
- One contract for every source
- Versioned wire, no surprises