SiteDolphinBot
Spotted SiteDolphinBot/1.0 in your logs? That's our crawler, and it was there on the site owner's behalf — our customers ask us to watch their own websites for broken links, broken images and certificate problems.
How the bot behaves
- Link crawling follows
robots.txt. - Weekly sweeps use at most two concurrent requests. Free checks use up to eight, with time and page limits.
- Reads the sitemap first and crawls at most a few hundred pages, once a week.
- Link sweeps store findings and technical measurements. Daily content checks keep a text baseline of up to 20,000 characters from the homepage.
Want to block it?
Add this to your robots.txt to block link crawling. Uptime, certificate and DNS monitoring are separate checks; contact us to stop all checks.
User-agent: SiteDolphinBot Disallow: /
Questions or complaints? Email info@olav.se and a human will reply.