Lumifer comments on Welcome to Less Wrong! (7th thread, December 2014) - Less Wrong

16 Post author: Gondolinian 15 December 2014 02:57AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (635)

You are viewing a single comment's thread. Show more comments above.

Comment author: advael 27 July 2015 05:41:56PM *  1 point [-]

A survey can be a reasonably designed experiment that simply gives us a weaker result than lots of other kinds of experiments.

There are many questions about humans that I would expect to be correlated with the noises humans make when given a few choices and asked to answer honestly. In many cases, that correlation is complicated or not very strong. Nonetheless, it's not nothing, and might be worth doing, especially in the absence of a more-correlated test we can do given our technology, resources, and ethics.

Comment author: Lumifer 27 July 2015 05:48:35PM 1 point [-]

What I had in mind was the difference between passive observation and actively influencing the lives of subjects. I would consider "surveys" to be observation and "experiments" to be or contain active interventions. Since the context of the discussion is kinda-sorta ethical, this difference is meaningful.

Comment author: advael 27 July 2015 07:00:36PM 1 point [-]

What intervention would you suggest to study the incidence of factual versus terminal-value disagreements in opposing sides of a policy decision?

Comment author: Lumifer 27 July 2015 07:14:09PM 2 points [-]

I am not sure where is this question coming from. I am not suggesting any particular studies or ways of conducting them.

Maybe it's worth going back to the post from which this subthread originated. Acty wrote:

If we set a benchmark that would satisfy our values ... then which policy is likely to better satisfy that benchmark...? But, of course, this is a factual question. We could resolve this by doing an experiment, maybe a survey of some kind.

First, Acty is mistaken in thinking that a survey will settle the question of which policy will actually satisfy the value benchmark. We're talking about real consequences of a policy and you don't find out what they are by conducting a public poll.

And second, if you do want to find the real consequences of a policy, you do need to run an intervention (aka an experiment) -- implement the policy in some limited fashion and see what happens.

Comment author: advael 27 July 2015 09:01:09PM 0 points [-]

Oh, I guess I misunderstood. I read it as "We should survey to determine whether terminal values differ (e.g. 'The tradeoff is not worth it') or whether factual beliefs differ (e.g. 'There is no tradeoff')"

But if we're talking about seeing whether policies actually work as intended, then yes, probably that would involve some kind of intervention. Then again, that kind of thing is done all the time, and properly run, can be low-impact and extremely informative.

Comment author: Acty 27 July 2015 10:24:18PM *  0 points [-]

--

Comment author: Lumifer 28 July 2015 12:23:36AM 0 points [-]

we should be doing science

Yep :-) That's why GlaDOS made an appearance in this thread :-D