User-agent: * Disallow: User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / # Block CazoodleBot as it does not present correct accept content headers User-agent: CazoodleBot Disallow: / # Block dotbot as it cannot parse base urls properly User-agent: dotbot/1.0 Disallow: / # Block Gigabot User-agent: Gigabot Disallow: / # Block dotbot as it cannot parse base urls properly User-agent: dotbot/1.0 Disallow: / User-agent: Qwantify Disallow: / User-agent: GoodBot Disallow: / # Sitemap Sitemap: https://www.oradeahub.com/sitemap/sitemap.xml