How to exclude bot from appearing on certain pages
Wanting to prevent your bot from appearing on certain pages of your website? You can use a targeting rule that allows you to exclude specific pages by their URL or by certain words in the URL. Here's how you can do that:
- Open the bot you would like to apply the targeting rule on.
- Go to Targeting at the top, scroll down till you reach the section to select a specific rule and choose Page URL.
You have five different conditions to choose from, what we are interested in is
- is not: Enter the full URL of the web page you would like to exclude(e.g.https://www.website.com/store/shoes/blue-shoes)
- doesn’t contain: Enter a part of the URL that you would like to exclude, if that part exists in any URL it will exclude it from appearing,(e.g. if we add“shoes” then any URL that has the word“shoes” in it will be excluded)
- Click on Publish on the top right to make the changes go live.
Note: If you are adding multiple pages to be excluded, make sure you choose to match All of these rules to exclude them all.