All of Keith Winston's Comments + Replies

I think 99% is within the plausible range of doom, but I think there's 100% chance that I have no capacity to change that (I'm going to take that as part of the definition of doom). The non-doom possibility is then worth all my attention, since there's some chance of increasing the possibility of this favorable outcome. Indeed, of the two, this is by definition the only chance for survival.

Said another way, it looks to me like this is moving too fast and powerfully and in too many quarters to expect it to be turned around. The most dangerous corners of the... (read more)

As to the last point, I agree that it seems likely that most iterations of AI can not be "pointed in a builder-intended direction" robustly. It's like thinking you're the last word on your children's lifetime worth of thinking. Most likely (and hopefully!) they'll be doing their own thinking at some point, and if the only thing the parent has said about that is "thou shalt not think beyond me", the most likely result of that, looking only at the possibility we got to AGI and we're here to talk about it, may be to remove ANY chance to influence them as adults. Life may not come with guarantees, who knew?

Warmly,

Keith

This is fantastic, thank you. Still digesting. 

I've been doing mindfulness training, mostly Sam Harris's Waking Up App, I have found it to be a good tool in that same direction, I think.

This is a really powerful direction to act from, I think.

This is lovely. I like the courteous tone treatment. I like the intent. I am excited about wading into the treasure trove of ideas here.

Where it says:

"They know they won't get extensions unless they kill their own mothers, and even economics students aren't that evil."

I would change it to:

"They know they won't get extensions unless they kill their own mothers, but these are only undergraduate economics students."