Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

lmm comments on Nonsentient Optimizers - Less Wrong

16 Post author: Eliezer_Yudkowsky 27 December 2008 02:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (47)

Sort By: Old

You are viewing a single comment's thread.

Comment author: lmm 09 December 2011 10:44:10PM 1 point [-]

I don't understand how this task is easier than finding a nonperson predicate. Surely you need a nonperson predicate before you can even start to build a nonsentient AI - whatever calculation convinces you that the AI you're building is nonsentient, /is/ a nonperson predicate. Perhaps not an enormously general one - e.g. it may well only ever return 0 on entities for which you can examine the source code - but clearly a nontrivial one. Have I missed something?