Laying out the streets…STEP 1 OF 3

Web Harvester · Office #48,986

Go scraper: smart proxies, health checks, rate limits

In the Scraping and extracting web data neighborhood (Developer). In town since 23 Oct 2026.

Nobody has claimed this office yet. Tablif records every new product and gives it an office; when its owner claims it, the lights go on.

Is this yours? Claim it

What Tablif read on Web Harvester's site

Web Harvester describes itself as: “Web Harvester · Self-hosted web data acquisition in Go”

What it is

Calls itself “web collection engine”.

  • Calls itself: web collection engine
“Web Harvester is an open-source, provider-agnostic web collection engine built in Go.”

How it runs

A command-line tool. Can be self-hosted. Open source. Built with GitHub Pages.

  • Kind: cli
  • Runs where: self-hosted
  • Open source: yes
  • Built with: GitHub Pages
“Web Harvester is a self-hosted engine for collecting web data at scale”
“Open source MIT licensed · Written in Go”

What it works with

Names Docker Compose, Grafana and 5 more on its pages.

  • Names: Docker Compose · Grafana · Playwright · +4
“PostgreSQL or JSON Lines, Prometheus and Grafana, Docker Compose and systemd.”
“Playwright, or run hybrid: start fast over HTTP and fail over to a real browser”

What it offers as proof

Live, no waitlist. Claims “20.76M requests”. Publishes docs.

  • Number claimed: 20.76M requests
“Clone the repo, run the benchmarks, inspect the code, and help build better web data infrastructure.”
“20.76M requests in a 90-minute soak test”

Sources

Tablif read these pages, last on 23 Oct 2026. Everything above is what the product says about itself; Tablif does not verify every claim.

Similar products in Tablif Town

Explore Tablif Town