You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Eugine_Nier comments on Beware Selective Nihilism - Less Wrong Discussion

39 Post author: Wei_Dai 20 December 2012 06:53PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (46)

You are viewing a single comment's thread. Show more comments above.

Comment author: [deleted] 21 December 2012 04:23:22AM *  0 points [-]

So basically: Redomain your utility function by composing it with an adaptor. Where the adaptor is a map from new-ontology -> old-ontology. Construct the adaptor by reverse-engineering your algorithms. Have I got that right?

Edit: No this sucks. Sometimes the old ontology doesn't make sense. I must think more. /Edit

That's a good statement of the problem, but I can see that "reverse engineer your algorithms" is the hard part, and we've just bottled it up as a black box. There's no obvious way to deal with cases that couldn't exist in your old ontology (brain damage can't exist in a simple dualist ontology, for example), or cases where there's a disagreement (teleportation and destructive-scan + print are different when things are ontologically basic, but more advanced physics says they are the same).

Some help may come from the fact that we seem to have some builtin support for ontology-shifting. It does happen successfully, though perhaps not always without loss. On the other hand people with the same ontology don't seem to diverge much by getting their through different update-chains.

Comment author: Eugine_Nier 21 December 2012 04:41:33AM 1 point [-]

On the other hand people with the same ontology don't seem to diverge much by getting their through different update-chains.

Not necessarily. Compare the positions of Multiheaded and yourself/Konkvistador w.r.t Moldbuggery.

Comment author: [deleted] 21 December 2012 07:23:45PM 0 points [-]

I wonder what the different chains are.