Révision 6ff32cea
Ajouté par Florent Torregrosa il y a environ 9 ans
drupal7/robots.txt | ||
---|---|---|
12 | 12 |
# |
13 | 13 |
# For more information about the robots.txt standard, see: |
14 | 14 |
# http://www.robotstxt.org/robotstxt.html |
15 |
# |
|
16 |
# For syntax checking, see: |
|
17 |
# http://www.frobee.com/robots-txt-check |
|
18 | 15 |
|
19 | 16 |
User-agent: * |
20 | 17 |
Crawl-delay: 10 |
Formats disponibles : Unified diff
Update core to 7.36