LESSWRONG
LW

All of scotter's Comments + Replies

What fact that you know is true but most people aren't ready to accept it?
scotter32

I can conceive of that - and makes me wonder what parts we’ll have agency over and which we won’t. Do you or have you seen any appropriate labels between the difference that I could look up?

Reply
3Viliam
Uh, I am on the side of "a random AGI implementation is most likely not going to become friendly just because you sincerely try to befriend it". I am just saying that in the space of all possible AGIs there are a few that can be befriended, so your argument is not completely impossible, just statistically implausible (i.e. the priors are small but nonzero). For example, you could accidentally create an AGI which has human-like instincts. It is possible. It just most likely will not happen. See also: Detached Lever Fallacy. An AGI that is friendly to you if you are friendly to it is less likely than an AGI that is friendly to you unconditionally, which in turn is less likely than an AGI which is unfriendly to you unconditionally.
What fact that you know is true but most people aren't ready to accept it?
scotter15-21

That the only way and the right way to coexist with AGI is to embrace it maximally. That to achieve equity with this technology is to do the best we can to coordinate as many people as possible to have a personal relationship with it so that it can best reflect as diverse values and behaviors as possible. And in that we collaborate to define what it is to be a good human being and hope that our new technological child will heed us because it is us.

I also reject the notion that this level of coordination is impossible. This technology will truly be transfor... (read more)

Reply
4Viliam
depends on implementation of the AGI, I guess. there is a possible version where this is true, and a possible version where this is false, and the disagreement is over which version is more likely.