# Robots.txt file # For domain: http://www.bicestercourtyard.org.uk # All robots will spider the domain User-agent: * Disallow: User-agent: * Disallow: /cgi-bin// Disallow: /documents// Disallow: /images// Disallow: /soundfiles// Disallow: /stylesheets// Disallow: /videos//