In Yoast, It is showing that “I don’t have Robots.txt file”.
So should I create it? and also do I need to add sitemap URL to that robot.txt file?
Click on Create robots.txt then add your sitemap there
Yes, it is important to tell the Web Bots about what are allowed them to crawl or what not. Example:- Let think you want to index your all posts/pages but sometimes it will also index your
TO stop it just add
User-agent: * Disallow: /wp-content/plugins/* Allow: / Sitemap: https://example.com/sitemap_index.xml
Extra Help from the God https://support.google.com/webmasters/answer/6062596