= 27d567bc2d48d9f40e9ccc20ea370b15)
wedrifid comments on Anthropomorphic AI and Sandboxed Virtual Universes - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (123)
I found this labelling distracting. Especially since when we are talking about "Friendly AI" humans are not even remotely friendly in the relevant sense. It isn't anything to do with 'pessimism'. Believing that humans are friendly in that sense would be flat out wrong.
I like the idea of the sandbox as a purely additional measure. But I wouldn't remotely consider it safe. Not just because a superintelligence may find a bug in the system. Because humans are not secure. I more or less assume that the AI will find a way to convince the creators to release it into the 'real world'.
Point taken - Friendliness for an AI is a much higher standard than even idealized human morality. Fine. But to get to that Friendliness, you need to define CEV in the first place, so improving humans and evolving them forward is a route towards that.
But again I didn't mean to imply we need to create perfect human-sims. Not even close. This is an additional measure.
This is an unreasonable leap of faith if the AI doesn't even believe that there are 'creators' in the first place.
Do you believe there are creators?