Skip to content

PostgreSQL

Stream rows straight into a table you already own, with the wire contract mapped to columns.

Get API keys
Category: Warehouse

Point an actor at a connection string and BatScrape writes results into a table as they land, rather than handing you a file to load later.

The wire contract is the schema. Each field in the contract maps to a column, and because the contract is versioned, a schema migration is something you read in a diff before it happens — not something you discover when a load fails.

What it does

  • Creates and migrates the destination table from the actor’s contract version.
  • Writes in batches, with the cursor committed alongside the rows, so a retry resumes instead of duplicating.
  • Leaves the connection open only for the length of the run.

What you need

A Postgres 14 or newer instance reachable from your deployment, and a role with CREATE on the target schema.

Ready to stop babysitting scrapers?

When no scraper exists for your source, BatScrape ships one.

Get API keys
  • One contract for every source
  • Versioned wire, no surprises