The Clowder logo — cat with magnifying glassStart an ask
Auto

Why did the research bot visit my site?

If your logs show a request from TheClowderResearch, The Clowder requested one of your public pages because it was a possible source for a research report.

Our user agent

Mozilla/5.0 (compatible; TheClowderResearch/1.0; +https://theclowder.ai/research-bot)

What the bot does

  • It requests public pages that may be sources for a report.
  • It reads a page to find evidence, and records the page’s address and the evidence it found.
  • When a page answers with status 403 or 429, the bot skips that page for seven days before it tries again.

Questions and opting out

To ask a question, request a correction, or opt your site out, write to us through the contact page with your site’s address. Standards and corrections explains how reports use sources.