You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

JGWeissman comments on LessWrong search traffic doubles - Less Wrong Discussion

22 Post author: Louie 25 March 2011 10:01PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (31)

You are viewing a single comment's thread.

Comment author: JGWeissman 25 March 2011 10:23:08PM *  4 points [-]

This probably would be bad for performance, but purely structural sections of the site could be loaded in no-indexed iframes.

If we were dealing with certain Russian search engines, structural sections could be no-indexed inline:

Russian search engines Yandex and Rambler introduce a new tag which only prevents indexing of the content between the tags, not a whole Web page.

<body>

Do index this text block.

<noindex>Don't index this text block</noindex>

</body>

Unfortunately, I don't see any indication that Google honors such a thing.

Comment author: Viliam_Bur 15 October 2011 01:29:26PM *  1 point [-]

If HTML is supposed to be about semantics of the page, the NOINDEX tag should have been a part of every HTML specification, at least since server-side scripting became popular.

There is a lot of repeated text on each page of many websites, that really isn't part of the content, such as: "write your comment here", "next page", "previous page", "username / password", "permalink", etc.

I wonder if your website contains a word "permalink" in each page and comment, and there is one page that is really about permalinks, whether Google can tell the difference.