Tyrrell_McAllister comments on A Problem About Bargaining and Logical Uncertainty - Less Wrong

23 Post author: Wei_Dai 21 March 2012 09:03PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (45)
Tags: counterfactual_mugging decision_theory logical_uncertainty

Comments (45)

You are viewing a single comment's thread.

Comment author: Tyrrell_McAllister 23 March 2012 03:54:42AM *  0 points [-]

Do I know that Staply would have decided as I decide, had he been given control of the universe and been told by Omaga and his calculator that the millionth digit of pi is even?

Comment author: gwern 23 March 2012 03:57:24AM 0 points [-]

I took it as being implied, yes. If Staply is an unknown algorithm, there's no point in trading.

Comment author: Tyrrell_McAllister 23 March 2012 04:05:38AM *  0 points [-]

Then it does seem that if Clippy had in fact been built to maximize paperclips by an agent with the right computational limitations, then Clippy would have been built to take the deal.

I'd say essentially the same thing about this problem as I said about the Counterfactual Mugging:

So, finding that you are declining Omega, contrary to UDT, isn't even necessarily bad news. It probably just means that your designers lucked out more than they deserved, which would be good news.

But that doesn't change the fact that your designers were stupid, and that you ought to want to do better. You ought to modify yourself and any of your progeny to act more in accord with UDT in the future.

Powered by Reddit Powered by Reddit