eli_sennesh comments on No Universally Compelling Arguments in Math or Science - Less Wrong

30 Post author: ChrisHallquist 05 November 2013 03:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (227)

You are viewing a single comment's thread. Show more comments above.

Comment author: TheAncientGeek 05 November 2013 05:36:46PM *  2 points [-]

UCAs are part of the Why can't the AGI figure Out Morality For Itself objection:-

  1. There is a sizeable chunk of mindspace containing rational and persuadable agents.

  2. AGI research is aiming for it. (You could build an irrational AI, but why would you want to?)

  3. .Morality is figurable-out, or expressible as a persuasive argument.

The odd thing is that the counterargument has focussed on attacking a version of (1), although, in the form it is actually held, it is the most likely premise. OTOH, 3, the most contentious, has scarely been argued against at all.

Comment author: [deleted] 10 November 2013 01:47:35PM 0 points [-]

AGI research is aiming for it. (You could build an irrational AI, but why would you want to?)

It's worth noting that for sufficient levels of "irrationality", all non-AGI computer programs are irrational AGIs ;-).

Comment author: TheAncientGeek 12 November 2013 09:04:56AM 2 points [-]

Contrariwise for sufficient values of "rational". I don't agree that that's worth noting.