JGWeissman comments on LessWrong search traffic doubles - Less Wrong

22 Post author: Louie 25 March 2011 10:01PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (31)

You are viewing a single comment's thread.

Comment author: JGWeissman 25 March 2011 10:23:08PM *  4 points [-]

This probably would be bad for performance, but purely structural sections of the site could be loaded in no-indexed iframes.

If we were dealing with certain Russian search engines, structural sections could be no-indexed inline:

Russian search engines Yandex and Rambler introduce a new tag which only prevents indexing of the content between the tags, not a whole Web page.

<body>

Do index this text block.

<noindex>Don't index this text block</noindex>

</body>

Unfortunately, I don't see any indication that Google honors such a thing.

Comment author: Viliam_Bur 15 October 2011 01:29:26PM *  1 point [-]

If HTML is supposed to be about semantics of the page, the NOINDEX tag should have been a part of every HTML specification, at least since server-side scripting became popular.

There is a lot of repeated text on each page of many websites, that really isn't part of the content, such as: "write your comment here", "next page", "previous page", "username / password", "permalink", etc.

I wonder if your website contains a word "permalink" in each page and comment, and there is one page that is really about permalinks, whether Google can tell the difference.