Custom Robots.txt Options

[steve]

You can now create and use your own robots.txt file as needed.

The robots.txt file lets search engines know what pages they can add to their search indexes. You can now make your own robots.txt file and customise the pages that are included in that index.

The default robots.txt file will allow search engines and other web-spiders to index every page on your dating site, if you want to keep this, you won't need to create a robots.txt file.

To create your own robots.txt file is very easy. In your DiyDating admin area select the Advanced Menu option and then select the Page Editor. Create a new page called robots and add the content that is required.

When you have created the page go back to the Page Editor and set the Include Headers to NO to prevent the default page header and footer showing.