Build a robots.txt file to control how search engines crawl your site.

Generated robots.txt
User-agent: *
Allow: /
Disallow: /admin/
Disallow: /private/

Sitemap: https://example.com/sitemap.xml

Powered by DigiMetrics Hub