Larks comments on Is an Intelligence Explosion a Disjunctive or Conjunctive Event? - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (15)
I think you're being unfair here. Presumably you think we need Many-Worlds for acausal trade, but this is far from obvious. Possible Worlds would do it too, and there are various decision theoretic ideas that make sense of it in a single world. Even beyond that though, it's not obvious that acausal trade is particularly important to SIAI's main thesis. SIAI wants to (maybe) build a seed AI, not do acausal trade.
And lots of work has gone into non-TDT theories - other UDTs, like the one Stuart's recently been discussing. Even then I don't see why ¬UDT -> ¬Intelligence Explosion.
This is a bad example; it's equally possible that we might be emitting too little CO2. There's a symmetry here that isn't obviously present in the AI case.
This is untrue; bounded utility functions. Maybe those aren't a good idea for other reasons, but there are systems that don't get mugged for better reasons than their gut.