User-Agent: * Disallow: /admin/ # disable crawling django admin Sitemap: https://aniwal.com/sitemap.xml