The only reliable method for identifying our crawler (Dragonbot) is by using the user agent string.

Here is an example of one of the user agent strings used by Dragonbot:

Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.80 Safari/537.36;Dragonbot;

Please note that several variations of this user agent string are in use, and may change from time to time. To identify the user agent as Dragonbot, please do not match the entire string. Instead, use the final part of the user agent string to identify it, which will remain constant:


Learn more about how to allow Dragonbot to crawl your site.

Did this answer your question?