By default, all sites are automatically crawled every two weeks. However, there are times when you make changes to your site and would like to crawl the site again (without waiting until the next automatic re-crawl).
You can also start a new re-crawl by clicking Re-crawl site now at the top of the Crawler Settings page.
Each account has a limited number of recrawls you can initiate per month, depending on your subscription plan.
If you're interested in a different crawling frequency (e.g. daily, every other day, weekly, etc.) please contact us.