= 27d567bc2d48d9f40e9ccc20ea370b15)
SoullessAutomaton comments on Open Thread: June 2009 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (142)
As an aside, "waiting for Eliezer to find a loophole" probably does not constitute a safe and effective means of testing AI utility functions. This is something we want provable from first principles, not "proven" by "well, I can't think of a counterexample".
Of course, hence "...and probably complicated in some other ways that haven't occurred to me in two minutes.".
Right. I know you realize this, and the post was fine in the context of "random discussion on the internet". However, if someone wants to actually, seriously specify a utility function for an AI any description that starts with "here's a high-level rule to avoid bad things" and then works from there looking for potential loopholes is deeply and fundamentally misguided completely independently of the rule proposed.