Why did the research bot visit my site?
If your logs show a request from TheClowderResearch, The Clowder requested one of your public pages because it was a possible source for a research report.
Our user agent
Mozilla/5.0 (compatible; TheClowderResearch/1.0; +https://theclowder.ai/research-bot)What the bot does
- It requests public pages that may be sources for a report.
- It reads a page to find evidence, and records the page’s address and the evidence it found.
- When a page answers with status 403 or 429, the bot skips that page for seven days before it tries again.
Questions and opting out
To ask a question, request a correction, or opt your site out, write to us through the contact page with your site’s address. Standards and corrections explains how reports use sources.
