Fed up with Content Scraper? Learn how to block - FREE of Cost

Most scrapping happens using RSS Feed. These two steps will prevent it.

Step 1. Remove the RSS feed discovery markup from the <head> ... </head> section

  • Use Code Snippets plugin (Recommended)
remove_action( 'wp_head', 'feed_links', 2 ); //removes feed links.
remove_action('wp_head', 'feed_links_extra', 3 );  //removes comments feed. 

Next

Step 2. Block access to Feed path

Here are three ways. Follow one.

Apache

RewriteRule (^|/)feed(/|$) - [F]

NGINX

location ~ (^|/)feed(/|$) {
  return 403;
}

Cloudflare WAF Expression

(http.request.uri contains "feed")

Caveats

  • Any automation services using RSS feed will stop working. Check logs if anything breaks.
  • Indexing may be slow

Thanks & Regards,
Gulshan

3 Likes

Thank you. Anyone else managed to stop scraper who are not using feed to scrape?

You’re welcome!