User-agent: * Disallow: /answers/Account Disallow: /answers/bundles Disallow: /answers/Comment Disallow: /answers/Content Disallow: /answers/DownloadFile.aspx Disallow: /answers/file Disallow: /answers/images Disallow: /answers/javascript Disallow: /answers/Question Disallow: /RecentlyViewed Disallow: /Default User-agent: DynoBot Disallow: / User-agent: Ezooms Disallow: / User-agent: SightupBot Disallow: / User-agent: trovitBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: sogou spider Disallow: / User-agent: BLEXBot Disallow: / User-agent: ShopWiki Disallow: / User-agent: MJ12bot Disallow: / User-agent: Exabot Disallow: / User-agent: CCBot Disallow: / User-agent: sistrix Disallow: / User-agent: XoviBot Disallow: / User-agent: Flamingo_SearchEngine Disallow: / User-agent: Nutch Disallow: / User-agent: ADmantX Disallow: / User-agent: grapeshot Disallow: / User-agent: CarsnipBot Disallow: / Sitemap: https://www.autotrader.co.za/sitemap/index