NixPhenom comments on Friendlier AI through politics - Less Wrong

1 Post author: Jonathan_Graehl 16 August 2009 09:29PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (41)

You are viewing a single comment's thread.

Comment author: NixPhenom 24 August 2009 05:29:26AM *  0 points [-]

What counts as an AGI? A system that can solve resource-allocation problems that satisfy its inbuilt values in a dynamic environment?

If one were to take Hayek's view of human marketplaces, we could consider our currently existing markets as greater-than-human intelligences by that standard.

What legal principles enable markets to work well? Theory and practice suggest that the necessary and sufficient conditions are: 1) property ownership and enforcement and 2) a sound currency of value-measurement.

So: how well have we imbued our emergently-superintelligent markets with values consistent with human well-being? I would suggest that we have succeed to the extent that the conditions above are met. Further, I'd suggest that FAI development should also hinge on those principles.