Sitemap: https://www.camperuk.co.uk/sitemap.xml User-agent:* Disallow: /website/modules/blog/blog_datalist.ajax.php$ Disallow: /ajax/ Disallow: /admin/ Disallow: /cms/ Disallow: /*?vehicle_id= Disallow: /callback-request Disallow: /new-callback-request Disallow: /callback-enquiry Disallow: /general-enquiry Disallow: /px-enquiry Disallow: /home-dev # blocking bad bots # http://www.opensiteexplorer.org/dotbot User-agent: DotBot Disallow: / User-agent: dotbot Disallow: / User-agent: rogerbot Disallow: / # http://ahrefs.com/robot/ user-agent: AhrefsBot disallow: / # http://go.mail.ru/help/robots User-agent: Mail.Ru Disallow: / # http://mj12bot.com/ User-agent: MJ12bot Disallow: / #Baiduspider User-agent: Baiduspider Disallow: / #Yandex User-agent: Yandex Disallow: /