You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Wei_Dai comments on A Brief Overview of Machine Ethics - Less Wrong Discussion

6 Post author: lukeprog 05 March 2011 06:09AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (90)

You are viewing a single comment's thread.

Comment author: Wei_Dai 06 March 2011 07:55:05PM *  9 points [-]

Earlier, I lamented that even though Eliezer named scholarship as one of the Twelve Virtues of Rationality, there is surprisingly little interest in (or citing of) the academic literature on some of Less Wrong's central discussion topics.

Eliezer defined the virtue of scholarship as (a) "Study many sciences and absorb their power as your own." He was silent on whether, after you survey a literature and conclude that nobody has the right approach yet, you should (b) still cite the literature (presumably to show that you're familiar with it), and/or (c) rebut the wrong approaches (presumably to try to lead others away from the wrong paths).

I'd say that (b) and (c) are much more situational than (a). (b) is mostly a signaling issue. If you can convince your audience to take you seriously without doing it, then why bother? And (c) depends on how much effort you'd have to spend to convince others that they are wrong, and how likely they are to contribute to the correct solution after you turn them around. Or perhaps you're not sure that your approach is right either, and think it should just be explored alongside others.

At least some of the lack of scholarship that you see here just reflect a cost-benefit analysis on (b) and (c), instead of a lack of "interest" or "virtue". (Of course you probably have different intuitions on the costs and benefits involved, and I think you should certainly pursue writing your book if you think it's a good use of your time.)

Also, I note that there is remarkably little existing research on some of the topics we discuss here. For example, for my The Nature of Offense post, I was able to find just one existing article on the topic, and that was in a popular online magazine, instead of an academic publication.

Comment author: lukeprog 07 March 2011 03:24:38AM *  1 point [-]

This is an excellent comment, and you're probably right to some degree.

But I will say, I've learned many things already from the machine ethics literature, and I've only read about 1/4 of it so far.

Comment author: Vladimir_Nesov 07 March 2011 12:08:04PM 1 point [-]

But I will say, I've learned many things already from the machine ethics literature

Such as?

Comment author: lukeprog 07 March 2011 05:41:43PM 0 points [-]

Hold, please. I'm writing several articles and a book on this. :)

Comment author: lukeprog 09 March 2011 04:44:19AM 1 point [-]

But for now, this was Louie Helm's favorite paper among those we read during our survey of the literature on machine ethics.

Comment author: Pavitra 06 March 2011 08:01:10PM 1 point [-]

Citing the literature makes it easier for your reader to verify your reasoning. If you don't, then a proper confirmation or rebuttal requires (more) independent scholarship to discover the relevant existing literature from scratch.