Do i need to add Sitemap URL to Robots.txt file?


In Yoast, It is showing that “I don’t have Robots.txt file”.
So should I create it? and also do I need to add sitemap URL to that robot.txt file?

Click on Create robots.txt then add your sitemap there

Sitemap: https://example.com/sitemap_index.xml
1 Like

Yes, it is important to tell the Web Bots about what are allowed them to crawl or what not. Example:- Let think you want to index your all posts/pages but sometimes it will also index your mysite.com/wp-content/plugins/any-plugin-here
TO stop it just add

User-agent: *
Disallow: /wp-content/plugins/*
Allow: /
Sitemap: https://example.com/sitemap_index.xml

Extra Help from the God https://support.google.com/webmasters/answer/6062596

1 Like