Our crawler

Last updated 2026-09-24

FastBuyrBot reads a company’s own public website for the contact details it publishes. It reads a handful of pages at most one request a second, and it obeys robots.txt. To stop it, add a robots.txt rule or write to us, and it stops for every FastBuyr customer at once.

1. What it is

FastBuyrBot is the website reader in FastBuyr, a sales platform operated by Digital Brain Media. When a FastBuyr customer finds a business through a search, or asks to know more about a company, it reads that business’s own public website for the ways the business says it can be reached: an email address, a phone number, a WhatsApp link. It also reads a customer’s own website when that customer asks it to describe their business.

It identifies itself in every request as FastBuyrBot/1.0 (VyomAnantaBot; +https://app.fastbuyr.com/crawler; business contact discovery).

2. What it reads, and how often

Pages

At most five pages of a site when looking for contact details, usually the home page and a contact or about page. At most twelve when reading what a business offers.

Pace

At most one request a second to any site, counted across every FastBuyr customer together, so your site sees one reader however many customers are interested in it.

robots.txt

It reads robots.txt first and obeys it, including Crawl-delay. If robots.txt cannot be read, it reads nothing. If your server answers 429 or 503 with Retry-After, it waits that long, for every customer.

Never

It never signs in, never submits a form, and never reads a page behind a password.

3. What it keeps

From a business’s website it keeps the contact details the site publishes, a few observations about the site itself (whether it loaded, whether it uses HTTPS), and a record of which pages it fetched and when, so that we can tell you if you ask. It does not keep copies of your pages.

The one exception is a FastBuyr customer’s own website: when a customer asks for their own site to be read so that FastBuyr can describe their business, its text is kept in that customer’s own account.

4. How to stop it

Add this to the robots.txt at the root of your site:

User-agent: FastBuyrBot
Disallow: /

It also answers to its earlier name, VyomAnantaBot, so a rule written for that name still applies.

Or write to team@fastbuyr.com with your domain. We add it to a list that stops the crawler for every FastBuyr customer at once, including the sites under your domain.