User-agent: * Disallow: /App-Code/ Disallow: /App-Data/ Disallow: /Bin/ Disallow: /RPDataExtraction/ Disallow: /catalog.wci Disallow: / App_GlobalResources Disallow: /App_WebReferences Disallow: /aspnet_client Disallow: /scripts Allow: /*?$ #allow files that contain question mark somewhere in the url string