Comment author: Daniel_Burfoot 13 October 2016 02:27:02AM 2 points [-]

Okay, I obviously don't mean that we should value-segregate people at the point of a gun. I mean that if people naturally want to migrate towards geopolitical communities that better fit their particular value system, this is probably a good thing.

Comment author: WalterL 13 October 2016 03:52:56AM 0 points [-]

Yeah, I agree that people being able to travel freely and choose where they live is good.

Comment author: Daniel_Burfoot 12 October 2016 06:49:03PM 1 point [-]

Downvoted for making a flippant, argument-based-on-fiction response to serious comment.

Comment author: WalterL 12 October 2016 07:53:10PM -1 points [-]

Here's a more serious response.

  1. Segregating the world, period, based on whatever, is impossible without a coercive power that the existing nations of earth would consider illegal. Before you could forcefully migrate a large percentage of the world's humans you'd have to win a war with whatever portion of the UN stood against you.
  2. If you could do it, no one would admit to having any values other than those which got to live in/own the nicest places/stuff/be with their family / not be with their competitors/whatever. The technology to determine everyone's values does not exist.
  3. If you somehow derived everyone's values and split them by these, you would probably be condemning large segments of the population to misery (Lots of people's values are built around living around people who don't share them.), and there would be widespread resentment. The invincible force you used to overcome objection 1 would be tested within a generation.
Comment author: MrMind 11 October 2016 01:06:33PM 1 point [-]

Is there a good rebuttal to why we don't donate 100% of our income to charity? I mean, as an explanation tribality / near - far are ok, but is there a good justification post-hoc?

Comment author: WalterL 12 October 2016 02:53:52PM 0 points [-]

"Don't wanna", shading into "Make Me" if they press. Anyone trying to tell you what to do isn't your Real Dad! (Unless they are, in which case maybe try and figure out what's going on.)

Comment author: MrMind 11 October 2016 07:23:41AM *  1 point [-]

I looked into some of the most obvious objections. Some have reasonable answers (why not just kill yourself?), some others are based on a (to me) crazy assumption: that the original state of the biosphere pre-humans somehow is more valuable than the collective experience of the human race.
To which I don't just disagree, but think it's a logic error, since values exist only in the mind of those who can compute it, whatever it is.

Comment author: WalterL 12 October 2016 02:51:36PM 2 points [-]

grumble grumble...

Look, I'm not pro-"Kill All Humans", but I don't think that last step is correct.

Bob can prefer that the human race die off and the earth spin uninhabited forever. It makes him evil, but there's no "logic error" in that, any more than there is in Al's preference that humanity spread out throughout the stars. They both envision future states and take actions that they believe will cause those states.

Comment author: Daniel_Burfoot 11 October 2016 07:34:51PM 0 points [-]

In my view, segregating the world by values would actually be really good. People who have very different belief systems should not try or be forced to live in the same country.

Comment author: WalterL 12 October 2016 02:46:05PM -1 points [-]

Yes, those with my values will live here, in Gondor. Your folks can live other there, in Mordor. Our citizens will no longer come into contact and conflict with one another, and peace will reign forever.

What, these segregated regions THEMSELVES come into conflict? Absurd. What would you even call a conflict that was between large groups of people? That could never happen. Everyone who shares my value system knows that lots of people would die, and we all agree that nothing could be worth that.

Comment author: WalterL 29 September 2016 02:42:11PM 4 points [-]

This article is an example of looking at the world pragmatically, and acknowledging an actual truth. Kudos to the writers.

It reminds me of the scene at the start of Bad Boyz 2, where the drug kingpin has a giant pile of paper cash, and rats are nesting in it.

Kingpin: "This is a STUPID problem to have." ... Kingpin: "But it IS a problem. Hire exterminators."

Similarly, politics getting in the way of transforming the world with its irksome interest in transforming the world is exactly the sort of thing that clear eyed futurists need to figure on.

In response to Linkposts now live!
Comment author: WalterL 28 September 2016 06:25:31PM 2 points [-]

Thanks for this. This was a smart change, and I doubt you were paid for it. I appreciate it.

Comment author: Ozyrus 26 September 2016 11:25:21PM *  1 point [-]

I've been meditating lately on a possibility of an advanced artificial intelligence modifying its value function, even writing some excrepts about this topic.

Is it theoretically possible? Has anyone of note written anything about this -- or anyone at all? This question is so, so interesting for me.

My thoughts led me to believe that it is theoretically possible to modify it for sure, but I could not come to any conclusion about whether it would want to do it. I seriously lack a good definition of value function and understanding about how it is enforced on the agent. I really want to tackle this problem from human-centric point, but i don't really know if anthropomorphization will work here.

Comment author: WalterL 28 September 2016 01:07:16PM 1 point [-]

On the one hand, there is no magical field that tells a code file whether the modifications coming into it are from me (human programmer) or the AI whose values that code file is. So, of course, if an AI can modify a text file, it can modify its source.

On the other hand, most likely the top goal on that value system is a fancy version of "I shall double never modify my value system", so it shouldn't do it.

Comment author: Sable 26 September 2016 10:08:43AM 3 points [-]

I was at the vet a while back; one of my dogs wasn't well (she's better now). The vet took her back, and after waiting for a few minutes, the vet came back with her.

Apparently there were two possible diagnosis: let's call them x and y, as the specifics aren't important for this anecdote.

The vet specifies that, based on the tests she's run, she cannot tell which diagnosis is accurate.

So I ask the vet: which diagnosis has the higher base rate among dogs of my dog's age and breed?

The vet gives me a funny look.

I rephrase: about how many dogs of my dog's breed and age get diagnosis x versus diagnosis y, without running the tests you did?

The vet gives me another funny look, and eventually replies: that doesn't matter.

My question for Lesswrong: Is there a better way to put this? Because I was kind of speechless after that.

Comment author: WalterL 26 September 2016 02:22:12PM 2 points [-]

So, it seems like there could be 2 things going on here:

1: Maybe, in your Vet's mind, she is telling you "We can't tell if this is A or B", and you are asking "But which is it?", and by refusing to answer she is doubling down on the whole "We don't know A or B" situation.

Like, I know what you mean is what you actually said, but normal people don't say that, and the Vet is trying to reiterate that you do not know which of A or B this is. She is trying to avoid saying "mostly A", and you saying "ok, treat A", and then the dog dies of B, and you are like "You said A, you fraud, I'm suing you!".

2: The vet honestly doesn't know the answer to your question. She is a person who executes the procedures in his/her manuals, not a person who follows the news about every animal's frequent ailments. In her world if an animal shows A you do X, if an animal shows B you do Y. Your question is outside of her realm of curiosity.

As far as another way to phrase this, I'd go with "Well, which do you think it is, A or B?". The vet's answer ought to be informed by her experience, even if it isn't explicitly phrased as "well, mostly this is what dogs suffer from". If she reiterates that there is no way to know, I'd figure this was a first case, CYA situation, and stress that I wouldn't be mad if she was wrong.

Comment author: gwern 02 September 2016 08:09:59PM 0 points [-]

Meta: is it time to switch these to bimonthly or less frequent? The past few months have seen very few quotes submitted, and none of particularly great quality.

Submitting...

Comment author: WalterL 20 September 2016 01:49:47PM 2 points [-]

Eh, it's not like there is a penalty for having a quotes thread with few submissions. Interested people will click them when they show up, others won't.

View more: Next