Our crawler

OpenReceiveBot

OpenReceiveBot is the crawler run by OpenReceive, the open-source project for accepting Bitcoin Lightning and stablecoin payments directly into your own wallet.

What it does

We study how online stores take payments: which platforms they run on, and which payment methods their checkout offers. We use what we find to:

  • publish aggregate statistics about payment options on the web, and
  • occasionally tell a store owner, once, when OpenReceive could add a payment option their store doesn’t have.

We never sell or share the data.

What it fetches

For each site, at most once every 90 days:

  • robots.txt
  • the home page, and up to two other public pages (such as a contact or payment-info page)
  • public, read-only store APIs that list enabled payment methods (for example WooCommerce’s Store API cart endpoint)

It sends one request at a time to your site, with a pause between requests.

It may also open your home page once in a standard headless browser, the way a visitor’s browser would (with its images, scripts and styles), to check that it loads and to keep a screenshot of it.

What it never does

  • place orders, enter payment details, or submit forms
  • log in, or create accounts
  • bypass CAPTCHAs, firewalls, or bot protection

How to block it

OpenReceiveBot obeys robots.txt. To block it completely:

User-agent: OpenReceiveBot
Disallow: /

To opt your domain out of both crawling and any contact, email info@openreceive.org with the domain name. We honour it permanently.

User-Agent string: OpenReceiveBot/1.0 (+https://openreceive.org/bot)