hyporational comments on An overall schema for the friendly AI problems: self-referential convergence criteria - Less Wrong

17 Post author: Stuart_Armstrong 13 July 2015 03:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (110)

You are viewing a single comment's thread. Show more comments above.

Comment author: hyporational 17 July 2015 05:52:08AM *  0 points [-]

If there are mistakes made or the environment requires adaptation, a sufficiently flexible intelligence can mediate the selection pressure.

Comment author: Lumifer 17 July 2015 02:39:08PM 1 point [-]

The end result still has to be for the failures to die or be castrated.

There is no problem with saying that values in future will "change" or "drift", but "evolve" is more specific and I'm not sure how will it work.

Comment author: jacob_cannell 17 July 2015 03:52:15PM 1 point [-]

Memetic evolution, not genetic.

Comment author: Lumifer 17 July 2015 03:55:20PM 0 points [-]

I understand that. Memes can die or be castrated, too :-/

Comment author: jacob_cannell 17 July 2015 08:34:26PM 0 points [-]

In your earlier comment you said "evolution requires selection pressure". There is of course selection pressure in memetic evolution. Completely eliminating memetic selection pressure is not even wrong - because memetic selection is closely connected to learning or knowledge creation. You can't get rid of it.