Skip to Content

Site Auditor

Website Auditor Crawler (formerly aa-bot)

What is Site Auditor?

Site Auditor is a web crawler used by AgencyAnalytics Auditor. Its goal is to detect and report SEO issues for a given website.

Site Auditor will only crawl websites for which a crawl has been requested by an AgencyAnalytics Auditor's user.

Specifications

  • User Agent: Mozilla/5.0 (compatible; RSiteAuditor)
  • Follows Allow/Disallow instructions of robots.txt: Yes
  • Crawl rate: Adapts to website's speed.
  • IP Addresses:

    94.130.93.30
    168.119.141.170
    168.119.99.190
    168.119.99.191
    168.119.99.192
    168.119.99.193
    168.119.99.194
    68.183.60.34
    134.209.42.109
    68.183.60.80
    68.183.54.131
    68.183.49.222
    68.183.149.30
    68.183.157.22
    68.183.149.129

How to disallow Site Auditor on a website?

Site Auditor follows the general instructions of a robots.txt as well as specific instructions given to user agent RSiteAuditor:

Here is a sample robots.txt that would forbid Site Auditor on a website:

User-agent: RSiteAuditor
Disallow: /

It is also possible to allow only a specific section of a website:

User-agent: RSiteAuditor
Disallow: /
Allow: /categories

Contact

If you wish to report an abusive behavior or if you want to ask questions about AgencyAnalytics Auditor, please contact our team.