robots.txt contains domain-specific settings.
Use robots-dist.txt as template for own robots file
This commit is contained in:
@ -1 +1,16 @@
|
||||
Sitemap: http://www.domain.org/sitemap.xml
|
||||
Sitemap: http://www.domain.org/sitemap.xml
|
||||
|
||||
User-agent: *
|
||||
Disallow: /search.php?*output=gpx*
|
||||
Disallow: /search.php?*output=gpx1*
|
||||
Disallow: /search.php?*output=gpx2*
|
||||
Disallow: /search.php?*output=garmin*
|
||||
Disallow: /search.php?*output=kml*
|
||||
Disallow: /search.php?*output=loc*
|
||||
Disallow: /search.php?*output=map*
|
||||
Disallow: /search.php?*output=map2*
|
||||
Disallow: /search.php?*output=ov2*
|
||||
Disallow: /search.php?*output=ovl*
|
||||
Disallow: /search.php?*output=txt*
|
||||
Disallow: /search.php?*output=xml*
|
||||
Disallow: /search.php?*queryid=*
|
@ -1,2 +0,0 @@
|
||||
Sitemap: http://www.opencaching.de/sitemap.xml
|
||||
User-agent: *
|
Reference in New Issue
Block a user