robots.txt contains domain-specific settings.

Use robots-dist.txt as template for own robots file
This commit is contained in:
ocoliver
2012-11-21 20:43:11 +01:00
parent 0f8c191694
commit b4312fe9cc
2 changed files with 16 additions and 3 deletions

View File

@ -1 +1,16 @@
Sitemap: http://www.domain.org/sitemap.xml
Sitemap: http://www.domain.org/sitemap.xml
User-agent: *
Disallow: /search.php?*output=gpx*
Disallow: /search.php?*output=gpx1*
Disallow: /search.php?*output=gpx2*
Disallow: /search.php?*output=garmin*
Disallow: /search.php?*output=kml*
Disallow: /search.php?*output=loc*
Disallow: /search.php?*output=map*
Disallow: /search.php?*output=map2*
Disallow: /search.php?*output=ov2*
Disallow: /search.php?*output=ovl*
Disallow: /search.php?*output=txt*
Disallow: /search.php?*output=xml*
Disallow: /search.php?*queryid=*

View File

@ -1,2 +0,0 @@
Sitemap: http://www.opencaching.de/sitemap.xml
User-agent: *