Skip to content
master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
inc
 
 
 
 
 
 
 
 
 
 

WP Robots Txt

This is a single serving plugin that adds a field on the Reading Settings WordPress admin page which allows you to edit your robots.txt file contents.

WP Robots Txt

Limitations

If you have a robots.txt file on your server, this plugins won't work. WordPress, in the server configuration it suggests by default, never overrides URLs that exist on your server. In other words, if robots.txt is on your server, WP will never even load -- Apache (or nginx or IIS) will serve that file directly.

Also, this plugin does not help you write valid a robots.txt file, nor will it alert you when you've written one that is invalid. That part is up to you.

FAQ

I totally screwed up my robots.txt file. How can I restore the default version?

Delete all the content from the Robots.txt Content field and save the privacy options.

Could I accidently block all search bots with this?

Yes. Be careful! That said, robots.txt files are suggestions. They don't really block bots as much as they suggest that bots don't crawl portions of a site. That's why the options on the Privacy Settings page say "Ask search engines not to index this site."

Where can I learn more about robots.txt files?

Here.

Changelog

1.0

  • Initial version

1.1

  • Cleaned up code
  • Moved to the settings field to the reading area

About

Adds an option to the Privacy Settings page that allows you edit the content of your `robots.txt` file.

Resources

License

Packages

No packages published

Languages