User-agent: * Disallow: /admin Disallow: /aspnet_client Disallow: /App_Code Disallow: /App_Themes Disallow: /bin Disallow: /externals Disallow: /includes Disallow: /pt Disallow: /*.axd$ User-agent: rogerbot Disallow: / User-agent: dotbot Disallow: / User-agent: BUbiNG Disallow: / User-agent: MJ12bot Disallow: / User-agent: spbot Disallow: / User-agent: aiHit Disallow: / User-agent: Yandex Disallow: / User-agent: Fatbot Disallow: /