Révision e33d3026
Ajouté par Julien Enselme il y a presque 10 ans
drupal7/robots.txt | ||
---|---|---|
11 | 11 |
# Ignored: http://example.com/site/robots.txt |
12 | 12 |
# |
13 | 13 |
# For more information about the robots.txt standard, see: |
14 |
# http://www.robotstxt.org/wc/robots.html
|
|
14 |
# http://www.robotstxt.org/robotstxt.html
|
|
15 | 15 |
# |
16 | 16 |
# For syntax checking, see: |
17 |
# http://www.sxw.org.uk/computing/robots/check.html
|
|
17 |
# http://www.frobee.com/robots-txt-check
|
|
18 | 18 |
|
19 | 19 |
User-agent: * |
20 | 20 |
Crawl-delay: 10 |
Formats disponibles : Unified diff
Update drupal to 7.30