User-agent: * Disallow: /logs/ Disallow: /cgi-bin/ Disallow: /scans/ Disallow: /_mm/ Disallow: /_notes/ Disallow: /_baks/ Disallow: /htsdata/ Disallow: /ftp/ Disallow: /stats/ Disallow: /kathy/ # Say no to wget # User-agent: wget Disallow: / # Say no to teleport # User-agent: teleport Disallow: / # Say no to HTTrack # User-agent: HTTrack Disallow: /