Basic information
About
WARDBot is a monitoring bot that tracks URL addresses added by user (s) to the monitoring list. It tracks URL status code of the web page in order to keep the user informed and notified about any downtimes of the added pages.
How bot works:
- The average request frequency is 10 minutes or more.
- By default, HTTP2 is used, but it can also be set to use HTTP1.
- HTTP headers may vary for different requested resources.
Robots.txt access
WARDBot strictly adheres to robots.txt rules, both disallow and allow. To allow WARDBot to access only certain parts of your site, you can add the WARDBot token to your site’s robots.txt as follows:
User-agent: WARDBot
Allow: /directory-1/
Disallow: /directory-2/
Robots.txt crawl delay
Specify the minimum acceptable delay between two consecutive requests in your robots.txt file as follows:
User-agent: WARDBot
Crawl-Delay: 10*Where Crawl-Delay value represents time in seconds
Contact us
If you believe that WARDBot is misbehaving on your website or if you have any questions, please reach out to us at and we'll do our best to help.
If you have more questions please use the following form
