Skip to content

Docdrift bot

DocdriftBot/1.0 (+https://docdrift.io/bot)

DocdriftBot reads public pages of sites that use Docdrift Verified. It reads a site only after its owner proves they control it in Docdrift, with a meta tag, a file or a DNS TXT record. To check that proof, it looks only for that tag, file or record, when the owner asks for it.

What it reads

The landing page and the public docs pages the site owner chose for Verified Features, and the uptime URL they chose.

How it reads

Each page is read from Docdrift's servers twice: once as DocdriftBot and once with a regular browser's user agent, without running scripts. DocdriftBot respects robots.txt.

How often

  • The uptime URL: every 5 minutes. A failed check is confirmed 30 seconds later.
  • Verified Features pages: once a week, and on paid plans also when the landing page changes, at most once a day.
  • The site verification: when the owner asks for it, and once a week.

Stop DocdriftBot

Want DocdriftBot to stop reading your site? Contact support