Maybe you saw my post about my problem to exclude the feed from the search result pages. To avoid duplicate content I wanted to exclude the feeds from the content, so they can not draw any attention from the actual blog post. Finally I found out why Google had denied my request and fixed that problem (I had made a mistake in the robots.txt). But there was an additional problem: what about the comment feeds?
I could exclude those feeds by including
disallow */feed/
but the as I have learned the robots.txt just prevents the search robots to spider a file, but it does not prevent it from showing up in the SERPs, when someone is linking to you. Therefore a
noindex
can help. I finally found the WordPress plugin “Don’t index my feed” which adds code to each feed to prevent the robots from indexing the files. Let’s see how this works.