About EnvoyantBot
If you found EnvoyantBot in your server logs, this page explains who we are and how to stop us.
What it is and why it visited
EnvoyantBot is the web crawler of Envoyant. It visited your website because someone asked us to scan it, to check how AI assistants can understand the business behind it.
It reads the public pages of the site, the same pages any visitor can open, and nothing else.
What it does
- Reads public pages only.
- Reads pages, and a few well-known public files such as llms.txt, with GET requests only. At most 20 of these requests are extra checks beyond the pages themselves.
- Reads at most 40 pages per free scan and at most 200 pages per paid scan.
- Makes at most one request per second to your site.
- Obeys your robots.txt file, including rules addressed to its own name (see below).
- If your site already offers an endpoint for AI agents, it sends each endpoint it finds at most 4 POST requests: asking it to describe itself, (for older servers) confirming the connection, and asking it to list what it offers. For older servers that open a session, it then sends one DELETE request to close that session. These are the only requests that are not GET, and they go only to that endpoint.
What it never does
- Log in to anything.
- Submit forms.
- Go behind paywalls or other access controls.
- Call any tool or action on an AI-agent endpoint. It only asks the endpoint to describe itself and to list what it offers.
How to stop it
Add the rule below to the robots.txt file at the root of your website. EnvoyantBot checks that file before it reads your pages and follows rules addressed to its name. This is the way to stop it.
The name to use in robots.txt
EnvoyantBot
robots.txt that blocks it completely
User-agent: EnvoyantBot
Disallow: /You can also allow only part of your site: use Allow and Disallow lines under the same name.
The user-agent it sends
Every request carries this user-agent string, exactly as shown. The link in it leads to this page.
EnvoyantBot/1.0 (+https://envoyant.net/bot)What we keep
Page text we read for a free scan is kept for 30 days. For paid plans the customer decides how long it is kept.
We do not keep personal data from pages beyond what the scan needs.
Contact
To stop the crawler immediately, use robots.txt as shown above. There is no need to write to us first.
Questions about the crawler: info@envoyant.net