User-agent: * Disallow: /clients/ Disallow: /cms/ Disallow: /files/ Disallow: /shop/