User-agent: * Disallow: /documents/ Disallow: /wp-admin Disallow: /cgi-bin/