Squark comments on Futarchy and Unfriendly AI - Less Wrong

9 Post author: jkaufman 03 April 2015 09:45PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (27)

You are viewing a single comment's thread.

Comment author: Squark 04 April 2015 06:31:33AM 9 points [-]

I think the crucial difference between AI and futarchy is that in AI the utility function is decided once an for all. Once a superintelligence is out there, there is no stopping it. On the other hand in futarchy the utility function is determined by some sort of democratic mechanism which operates continuously, that can introduce corrections it if things start going awry.