User-agent: * Disallow: /cgi-bin Disallow: /debian Disallow: /debian-cd Disallow: /debian-non-US Disallow: /kernel Disallow: /pub Disallow: /redhat Disallow: /freshrpms Disallow: /slorpms Disallow: /updates