diff options
Diffstat (limited to 'guides/source/configuring.md')
| -rw-r--r-- | guides/source/configuring.md | 16 |
1 files changed, 9 insertions, 7 deletions
diff --git a/guides/source/configuring.md b/guides/source/configuring.md index 994cc31cff..ab1cc9306f 100644 --- a/guides/source/configuring.md +++ b/guides/source/configuring.md @@ -1053,17 +1053,19 @@ These configuration points are then available through the configuration object: Search Engines Indexing ----------------------- -Sometimes, you may want to prevent some pages of your application be visible on search sites like Google, -Bing, Yahoo or Duck Duck Go. The robots that index these sites will first analyse the -`https://your-site.com/robots.txt` file to know what pages it is allowed to index. +Sometimes, you may want to prevent some pages of your application to be visible +on search sites like Google, Bing, Yahoo or Duck Duck Go. The robots that index +these sites will first analyse the `http://your-site.com/robots.txt` file to +know which pages it is allowed to index. -Rails creates this file for you on `/public` folder. By default, it allows search engines to index all -pages of your application. If you want to block indexing on all pages of you application, use this: +Rails creates this file for you inside the `/public` folder. By default, it allows +search engines to index all pages of your application. If you want to block +indexing on all pages of you application, use this: ``` User-agent: * Disallow: / ``` -To block just specific pages, it's necessary to use a more complex syntax. Learn it on the -[official documentation](http://www.robotstxt.org/robotstxt.html). +To block just specific pages, it's necessary to use a more complex syntax. Learn +it on the [official documentation](http://www.robotstxt.org/robotstxt.html). |