Psy-Kosh comments on What Program Are You? - Less Wrong

28 Post author: RobinHanson 12 October 2009 12:29AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (42)

You are viewing a single comment's thread. Show more comments above.

Comment author: Psy-Kosh 12 October 2009 07:50:13PM 0 points [-]

What if you can only approximate that equation instead of computing it directly, so that it's possible that you and the equation will have different outputs? Should the equation be about your approximation of it, or should you just try to approximate the original equation?

Incidentally, that's essentially a version the issue I was trying to deal with here (and in the linked conversation between Silas and I)

Comment author: SilasBarta 12 October 2009 08:00:51PM 1 point [-]

Ooh! Good point! And for readers who follow through, be sure to note my causal graph and my explanation of how Eliezer_Yudkowsky has previously accounted for how to handle errors when you can't compute exactly what your output will be due to the hardware's interference [/shameless self-promotion]

Comment author: Psy-Kosh 12 October 2009 08:25:26PM 0 points [-]

If you're right, I'd be extra confused, because then Eliezer could account for the sort of error I was describing, in terms of ambiguity of what algorithm you're actually running, but could not deal with the sort of errors due to one merely approximating the ideal algorithm, which I'd think to be somewhat of a subset of the class of issues I was describing.

Well, either way, as long as the issue is brought to the front and solved (eventually) somehow, I'm happy. :)

Comment author: SilasBarta 12 October 2009 08:40:38PM 1 point [-]

The difference is that Newcomb's problem allows you to assume that your (believed) choice of output is guaranteed to be your actual decision.

Post-computation interference only occurs in real-life scenarios (or hypotheticals that assume this realistic constraint), and it is those scenarios where Eliezer_Yudkowsky shows that you should pick a different computation output, given its robustness against interference from your "corrupted hardware".