Matt Cutts recently wrote an article on his blog entitled Search results in search results. The synopsis of his post was basically a request for websites to start blocking their search pages from being indexed.
You can do this rather easily by opening your robots.txt file and adding the following code:
User-agent: *
Disallow: /no-spider
Obviously just alter the /no-spider to reflect the search directory you don’t want indexed.
The problem being sites like real estate websites, Amazon, yelp and Wal-Mart would have a problem with that. There was an example of a user searching for a “dvd player.” The search resulted lists from Amazon and a few other sites that sell dvd players, the problem being that the search in Amazon resulted in amazons own search, showing a list of dvd players.
This to me (an end user) is no problem, primarily because that is exactly what I am looking for. I would like to see several options and brands for a dvd player. I am hoping Matt Cutts will follow up with a post clarifying this bit better.
