By default, all sites are automatically crawled every two weeks. However, there are times when you make changes to your site and would like to crawl the site again (without waiting until the next automatic re-crawl).

You can start a re-crawl of the site at any time by navigating to the Site Auditor, Site Explorer, Core Web Vitals, or URL X-Ray reports and clicking Re-crawl site now in the upper right of the page.

You can also start a new re-crawl by clicking Re-crawl site now at the top of the Crawler Settings page.

Each account has a limited number of recrawls you can initiate per month, depending on your subscription plan.

If you're interested in a different crawling frequency (e.g. daily, every other day, weekly, etc.) please contact us.

Did this answer your question?