Solvent comments on Why We Can't Take Expected Value Estimates Literally (Even When They're Unbiased) - Less Wrong

75 Post author: HoldenKarnofsky 18 August 2011 11:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (249)

You are viewing a single comment's thread. Show more comments above.

Comment author: Will_Newsome 21 August 2011 10:47:34AM *  4 points [-]

Dude, it's right there: "feasibility and difficulty", in this sentence which I am now repeating for the second time:

aimed largely [i.e. primarily] at doing the technical analysis necessary to determine as well as possible the feasibility and difficulty [e.g. how many Von Neumanns, Turings, and/or Aristotles would it take?] of Friendly AI for various (logical) probabilities of Friendliness [e.g. is the algorithm meta-reflective enough to fall into (one of) some imagined Friendliness attractor basin(s)?]").

(Bold added for emphasis, annotations in [brackets] were in the original.)

The next sentence:

Value of information regarding difficulty of Friendly-ish AI is high, but research into that question is naturally tied to Friendly AI theory itself.

Or if you really need it spelled out for you again and again, the output would primarily be (3) but secondarily (2) as you need some of (2) to do (3).

Because you clearly need things pointed out multiple times, I'll remind you that I put my response in the original comment that you originally responded to, without the later clarifications that I'd put in for apparently no one's benefit:

If I had a viable preliminary Friendly AI research program, aimed largely at doing the technical analysis necessary to determine as well as possible the feasibility and difficulty of Friendly AI for various values of "Friendly" [...]

(Those italics were in the original comment!)

If you're going to ask for money on LW

I wasn't asking for money on Less Wrong! As I said, "I was trying to quickly gauge vague interest in a vague notion." What the hell are you talking about.

I now doubt your ability to write your response ab initio.

I've doubted your ability to read for a long time, but this is pretty bad. The sad thing is you're probably not doing this intentionally.

Comment author: Solvent 21 August 2011 11:02:50AM 4 points [-]

To save some time and clarify, this was option 3: an analysis that purports to say whether or not Friendly AI is "feasible".