ArisKatsaris comments on The 5-Second Level - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (310)
Nitpick: It took me a bit to realize you meant "going back to being among non-rationalists" rather than "going back to the meeting".
Unfortunately I recognize that as the bitter truth, so it's of no use for me for training purposes.
Here's something which might work as an indignation test-- could it be a good move for an FAI to set a limit on human intelligence?
If an AI can be built, it has been shown that humanity is an AI-creating species. As technology and the promulgation of human knowledge improves, it will become easier and easier to make AIs, and the risk of creating a UFAI that the FAI can't defeat goes up.
It will be easier to have people who can't make AIs than to try to control the tech and knowledge comprehensively enough to make sure there are no additional FOOMs.
I considered limiting initiative (imposing akrasia) rather than intelligence, but I think that would impact a wider range of human values.
Same here. I suggest Eliezer edit it to make the intent more clear at first reading.