# # # Robots.txt file from http://www.online-catalogues.co.uk/robots.txt # # All robots will spider the domain User-agent: * Disallow: /?orderby= Disallow: /?number_products= Disallow: Sitemap: http://www.online-catalogues.co.uk/sitemap.xml