diff options
| author | David Heinemeier Hansson <david@loudthinking.com> | 2007-09-20 23:16:06 +0000 |
|---|---|---|
| committer | David Heinemeier Hansson <david@loudthinking.com> | 2007-09-20 23:16:06 +0000 |
| commit | bd311ce9221f1df9711c791d9abfae89e029924d (patch) | |
| tree | 67b321a09666117bb08de743d98886e913d828c3 /railties/html/robots.txt | |
| parent | 09e76e6acacb5f90dfc67d50c44b8257d36c4e95 (diff) | |
| download | rails-bd311ce9221f1df9711c791d9abfae89e029924d.tar.gz rails-bd311ce9221f1df9711c791d9abfae89e029924d.tar.bz2 rails-bd311ce9221f1df9711c791d9abfae89e029924d.zip | |
Updated some docs to reference the latest and greatest and played style nazi a little
git-svn-id: http://svn-commit.rubyonrails.org/rails/trunk@7517 5ecf4fe2-1ee6-0310-87b1-e25e094e27de
Diffstat (limited to 'railties/html/robots.txt')
| -rw-r--r-- | railties/html/robots.txt | 6 |
1 files changed, 5 insertions, 1 deletions
diff --git a/railties/html/robots.txt b/railties/html/robots.txt index 4ab9e89fe1..085187fa58 100644 --- a/railties/html/robots.txt +++ b/railties/html/robots.txt @@ -1 +1,5 @@ -# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
\ No newline at end of file +# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file +# +# To ban all spiders from the entire site uncomment the next two lines: +# User-Agent: * +# Disallow: / |