RankdarBot, the Rankdar site crawler

RankdarBot visits a website only when a Rankdar user starts a Site Health audit for it. It reads public pages the way a search engine does and reports technical SEO issues to that user.

How to recognise it

Every request carries this user agent:

RankdarBot/1.0 (+https://rankdar.com/bot)

How it behaves

• It follows robots.txt rules written for RankdarBot, or for all crawlers (*) when there are none.
• It only requests public pages over HTTP and HTTPS: no forms, no log-ins, no cookies.
• It stays on the audited domain and never follows links to other websites.
• It makes a few requests at a time and stops at the page limit of the audit.
• It does not render or run the site's JavaScript.

Block RankdarBot

Add these lines to your robots.txt. The next audit of your site will stop before fetching any page.

User-agent: RankdarBot
Disallow: /

Allow RankdarBot

If your robots.txt only allows specific crawlers, or a firewall blocks unknown bots, add these lines (and allow the RankdarBot user agent in the firewall) so your audits can run:

User-agent: RankdarBot
Allow: /