The pages crawled data report the total number of pages our crawler's been able to crawl in a particular crawl. You can find this metric in the top section of the Site Auditor and Site Explorer, or in the Page Crawled chart in the Site Auditor Overview page

How can this metric be useful?

  • The first reason to use this metric is to examine whether Dragonbot can crawl your site as your defined crawl scope and crawl limits, if you haven't
  • Also it can be used as an extra data point to access your website crawlability to search engines - If you've made sure Dragonbot is having no issue crawling your site but there's still a very little amount of pages being crawled, it's possible that search engines will have difficulty crawling and indexing your pages. You can dig deeper into your site's crawlability issue using our Site Auditor.
Did this answer your question?