# Robots.txt file from http://www.searchengineworld.com # # All robots will spider the domain User-agent: * Sitemap: http://www.nothingtodo.co.uk/sitemap.xml Disallow: /images/ Disallow: /content/files Disallow: /content/images Disallow: /admin/ Disallow: /includes/ Disallow: /profiles/ Disallow: /staff/ Disallow: /templates/ Disallow: /useruploads/ Disallow: /*.swf$ Disallow: /rateitem.php Disallow: /tellafriend.php