# /robots.txt for http://www.bitwizard.nl/ # I want to allow everything. Some robots abstain if they can't find a # robots.txt. I don't really know the format for this file when everything # is allowed, so I'm disallowing two things that don't exist..... # User-agent: * # attention all robots: Disallow: /cgi-bin/ # infinite URL space Disallow: /tmp/ # temporary files