# # robots.txt for http://botzeit.de # # Please note: There are a lot of pages on this site, and there are # some misbehaved spiders out there that go _way_ too fast. If you're # irresponsible, your access to the site may be blocked. Sitemap: http://botzeit.de/.sitemap Sitemap: http://botzeit.de/blog.sitemap Sitemap: http://botzeit.de/videos.sitemap Sitemap: http://botzeit.de/veranstaltung.sitemap User-agent: * Disallow: /styles/ Disallow: /images/ Disallow: /blog/*.txt Disallow: /buecher/*.txt Disallow: /impressum.txt Disallow: /veranstaltung/robotik.ics # # *at least* 1 second please. preferably more # Crawl-delay: 1