Sitemap: https://www.divorcelaws.co.za/sitemap.xml User-agent: NerdyBot Disallow: / User-agent: dotbot Crawl-delay: 10 User-agent: * Disallow: /ajax/ Disallow: /apps/ Disallow: /newsletter-august.html Disallow: /newsletter-september-2016.html Disallow: /family-law-newsletter-2017.html Disallow: /http://www.divorceattorney.co.za/charity-organisations.html Disallow: /payment-page.html Disallow: /international-divorce-payment.html