# All robots will spider the domain User-agent: * Disallow: /home.html Disallow: /admin/ Disallow: /aspnet_client/ Disallow: /cgi-bin/ Disallow: /changelog/ Disallow: /database/ Disallow: /graphics/ Disallow: /newsletters/testdropdown/ Disallow: /photos/