diff options
| author | Enrico Carlesso <enricocarlesso@gmail.com> | 2012-05-11 11:50:15 +0200 |
|---|---|---|
| committer | Enrico Carlesso <enricocarlesso@gmail.com> | 2012-05-11 11:50:15 +0200 |
| commit | 1abf15657b47b32dd5ba295bcdb618b41b46c0bc (patch) | |
| tree | f99d6245fabdaacba697094458206af7382bcedb /guides | |
| parent | 9b4514c3b8ecfbc40a44dbd4c2ebd4ce67f4a459 (diff) | |
| download | rails-1abf15657b47b32dd5ba295bcdb618b41b46c0bc.tar.gz rails-1abf15657b47b32dd5ba295bcdb618b41b46c0bc.tar.bz2 rails-1abf15657b47b32dd5ba295bcdb618b41b46c0bc.zip | |
In robots.txt, User-agent should be all downcase except for the first 'U', according with http://en.wikipedia.org/wiki/Robots_exclusion_standard
Diffstat (limited to 'guides')
| -rw-r--r-- | guides/code/getting_started/public/robots.txt | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/guides/code/getting_started/public/robots.txt b/guides/code/getting_started/public/robots.txt index 085187fa58..1a3a5e4dd2 100644 --- a/guides/code/getting_started/public/robots.txt +++ b/guides/code/getting_started/public/robots.txt @@ -1,5 +1,5 @@ # See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: -# User-Agent: * +# User-agent: * # Disallow: / |