red75 comments on Open Thread June 2010, Part 2 - Less Wrong

7 Post author: komponisto 07 June 2010 08:37AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (534)

You are viewing a single comment's thread. Show more comments above.

Comment author: red75 08 June 2010 02:28:45PM *  -1 points [-]

CEV will be to maintain existing order.

Why? There must be very strong arguments for BEs to stop doing the Right Thing. And there's only one source of objections - children. And their volitions will be selfish and unaggregatable.

EDIT: What does utility-function-neutral mean?

EDIT: Ok. Ok. CEV will be to make BE's morale change and allow them to not eat children. So, FAI will undergo controlled shutdown. Objections, please?

EDIT: Here's yet another arguments.

Guidelines of FAI as of may 2004.

  1. Defend humans, the future of humankind, and humane nature.

BEs will formulate this as "Defend BEs (except for the ceremony of BEing), the future of BEkind, and BE's nature."

  1. Encapsulate moral growth.

BEs never considered, that child eating is bad. And it is good for them to kill anyone who thinks otherwise. There's no trend in moral that can be encapsulated.

  1. Humankind should not spend the rest of eternity desperately wishing that the programmers had done something differently.

If they stop being BE they will mourn their wrong doings to the death.

  1. Avoid creating a motive for modern-day humans to fight over the initial dynamic

Every single notion that FAI will make in lines of "Let's suppose that you are non-BE" will cause it to be destroyed.

  1. Help people.

Help BEs everytime, but the ceremony of BEing.

How this will take FAI to the point that every conscious being must live?