Notes from building
the scrape layer
Field notes from the engineers who build and run the actors.
Posts
Latest notes from the build
-
ignore-scripts=true is a control, not a preference
-
Metering has to be exact, not eventually consistent
-
Finding where the data actually comes from
-
Golden vectors, and refusing to run on an empty set
-
An MCP surface is not a wrapper around your API
-
A boundary rule you cannot prove still fires is a comment
Ready to stop babysitting scrapers?
When no scraper exists for your source, BatScrape ships one.
Get API keys
- One contract for every source
- Versioned wire, no surprises