# All robots will spider the domain User-agent: * Disallow: # Disallow directory /Images/ User-agent: * Disallow: /Images/ # Disallow directory /Misc/ User-agent: * Disallow: /Misc/ # Disallow file 404.htm User-agent: * Disallow: 404.htm User-agent: * Disallow: /scouts/