How to Non-Index a Domain or Subdomain on Cloudflare

Introduction

This guide provides a step-by-step process on how to non-index a domain or subdomain using Cloudflare. By following these instructions, users will learn how to set up transform rules that prevent their website from being indexed by search engines.

Step-by-Step Instructions

Accessing Transform Rules

To begin, you need to navigate to the transform rules section in Cloudflare.

Searching for Transform Rules

First, use the search functionality to find "transform rules".

Clicking on Transform Rules

Once you find it, click on the transform rules option.

Selecting Your Domain

You will then need to choose the domain you want to non-index, in this case, "refl.ai".

Choosing Response Behavior Modifier

Next, select the modifier for response behavior.

Creating a New Rule

You can now create a new rule for the domain.

Setting Up the Error

If you have previously set up an error for "refl.ai", you can continue from there.

Clicking on Subdomain Indexing

Next, click on the option for subdomain indexing.

Choosing a Custom Filter Expression

You will need to choose a custom filter expression.

Setting the Full Path Conditions

Set the conditions for the full path to ensure it matches "refl.ai" or does not start with the specified domains.

Configuring the X-Robots Tag

You will then configure the xrobots tag to allow non-index and non-follow values.

Saving the Rule

Once everything is set up, click on save to finalize the rule configuration.

Enabling the Rule

Lastly, if you want to enable this rule, click on the enable button.

Confirmation of Non-Indexing

This rule will work across all subdomains that are not specifically described in your settings.

Conclusion

By following the steps outlined in this guide, you can successfully non-index a domain or subdomain on Cloudflare. The included screenshots provide visual support to ensure you can complete the task with ease.