Search Over 30,000 FREE Plugins from the Official WordPress Plugin Directory Repository

DB Robots.txt

DB Robots.txt automatically creates a virtual file robots.txt including special rules for Yandex.

DB Robots.txt is an easy (i.e. automated) solution to creating and managing a robots.txt file for your site. It is easy to create a robots.txt without FTP access.

If the plugin detects an existing XML sitemap file it will be included into robots.txt file.

It automatically includes the host-rule for Yandex.

Author Denis Bisteinov
Profile
Contributors DenisBisteinov
Tags crawler, robot, robots, robots.txt, yandex
  1. Upload bisteinoff-robots-txt folder to the /wp-content/plugins/ directory
  2. Activate the plugin through the 'Plugins' menu in WordPress
  3. Enjoy

1.0

  • Initial release.

Will it conflict with any existing robots.txt file?

If a physical robots.txt file exists on your site, WordPress won't process any request for one, so there will be no conflict.

Will this work for sub-folder installations of WordPress?

Out of the box, no. Because WordPress is in a sub-folder, it won't "know" when someone is requesting the robots.txt file which must be at the root of the site.

Share  
Download
Version 1.0

Requires WordPress version: 4.0 or higher

Compatible up to: 4.6.3

Last Updated 08 Dec 2016

Date Added: 08 Dec 2016

Plugin Homepage

Evaluation
star1
star2
star3
star4
star5

5 stars
1 ratings
256 downloads

Compatibility

Not Enough Data

Reports:
Works: 0
Broken: 0