= 27d567bc2d48d9f40e9ccc20ea370b15)
torekp comments on The Blue-Minimizing Robot - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (159)
I don't see that, why would it "care" if its goal isn't complex enough to allow it to care about the subversion of its sensors? I mean, the level of intelligence seems irrelevant here. Intelligence isn't even instrumental to such simple goals because all it "wants" is to fire a laser at blue objects. Its utility function says nothing about maximizing its efficiency or anything like that.
Unfortunately, your question is unanswerable, at least until Yvain invents the rest of the story. We haven't been told what goals, if any, are embodied in the intelligent part of the code. Strike that "if any" part, though - I think we can infer that it has goals from the specification that it has human-level intelligence. And even infer something about what some of the goals are like (truth-seeking, for example).
We also haven't been told the relationship between blue-zapping code and intelligence - whether it is physically possible, for example, for the intelligent processes to modify the blue-zapping code modules.
Edit: Psy-Kosh raised similar questions.