gjm comments on Open Thread March 31 - April 7 2014 - Less Wrong

2 Post author: beoShaffer 01 April 2014 01:41AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (234)

You are viewing a single comment's thread. Show more comments above.

Comment author: Metus 02 April 2014 09:01:36AM 1 point [-]

There are plenty of internet articles that I want to read later or have read but want to preserve for rereading and reference. Because of link rot I can't trust the sites to exist for arbitrary amounts of time, so I need to save these sites somehow. How do you do that in the most comfortable way, ideally a single click?

Comment author: gwern 02 April 2014 05:43:24PM 3 points [-]

You can do what I do: http://www.gwern.net/Archiving%20URLs

High startup cost, but on the plus side, you don't need to do anything once it's running and it'll catch most of what you read.

Comment author: gjm 03 April 2014 01:53:41PM 2 points [-]

OT (except that I ran into this while visiting that page): That Beeline thing is really annoying. (I got the "blues" variant. I was annoyed enough by it that I modified the cookie to serve me a different version. I asked it for variant 3 ("gray1") and actually it doesn't appear to be doing anything; maybe that's a bug somewhere. Anyway, my apologies if this introduces noise into your A/B/.../I testing.)

Comment author: gwern 03 April 2014 02:41:23PM *  0 points [-]

'Blues' is actually the best-performing variant so far! I have no idea why, I hate it too. If it succeeds, I'll probably have to run another to try to find a version I can live with. 'gray1' is, IIRC, probably the subtlest of the running versions, so unless you set up a second identical tab set to 'none' and flicker back & forth, I suspect you simply weren't noticing.

EDIT: 'Blues' eventually succumbed, and the final result was no version clearly outperformed no-BLR at all. See http://www.gwern.net/AB%20testing#beeline-reader-text-highlighting

Comment author: gjm 03 April 2014 05:05:48PM 2 points [-]

Does the metric you're using (fraction of visitors staying at least N seconds?) actually measure what you care about? (A few possible confounding factors, off the top of my head: visitors may be intrigued by the weird colours and stay around while they try to work out what it is, but this doesn't indicate that they got any actual value from the page content; if the Beeline thing works, visitors may find the one bit of information they're looking for faster and then leave; if it's just annoying, annoyance may show up in reduced repeat visits rather than likelihood of disappearing quickly.)

Comment author: gwern 03 April 2014 05:33:29PM 0 points [-]

I think it's a reasonable metric. It's not perfect (I'd rather measure average time on page, not a cutoff), but I don't know how to do any better: I am neither a Javascript programmer nor a Google Analytics expert.