#accept all spiders User-agent: * # disallow index core root folders/files Disallow: /bin/ Disallow: /Classes/ Disallow: /Common/ Disallow: /css/ Disallow: /Holding/ Disallow: /info/ Disallow: /Interfaces/ Disallow: /javascript/ Disallow: /masterpages/ Disallow: /obj/ Disallow: /Routing/ Disallow: /Secure/ Disallow: /UserControls/ Disallow: /Global.asax Disallow: /Redirect.aspx Disallow: /ViewBasket.aspx Disallow: /web.config Disallow: /CacheStats.aspx Disallow: /01/landing/superdry.htm Disallow: /01/superdry Disallow: /01/mens/superdry Disallow: /*superdry Disallow: /api/ Disallow: /02/fts/ Noindex: /02/fts/ Disallow: /*havaianas Disallow: /01/womens/superdry Disallow: /*poloralphlauren Disallow: /*Superdry Disallow: /*Polo-Ralph-Lauren Disallow: /Servicehealth.health Noindex: /Servicehealth.health Disallow: /*Animal Disallow: /*animal Disallow: /*Ellesse Disallow: /*ellesse