shminux comments on Uncritical Supercriticality - Less Wrong

47 Post author: Eliezer_Yudkowsky 04 December 2007 04:40PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (159)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: Abd 06 November 2012 06:48:29PM 0 points [-]

You are welcome, shminux. Since you used this collection of letters, "reductionism," and appear to posit that my view is "incompatible" with it, I looked it up. Yukdowsky's article, for starters. Aside from EY using the device of positing a series of stupid arguments to refute, and being a bit naive about what others "believe," when he actually gets to the definition, it seems quite like the way I think. In fact, if I hadn't noticed this many times, reading his work, I'd not be bothering with LW at all.

Yet I'm suspicious of any "ism," a high-level abstraction, proposed as if representing reality. Indeed, wouldn't a reductionist be suspicious?

Reductionism as a practical approach, fine.

Now, I notice that EY, in the post, capitalizes Reality.

But the way physics really works, as far as we can tell, is that there is only the most basic level—the elementary particle fields and fundamental forces. You can't handle the raw truth, but reality can handle it without the slightest simplification. (I wish I knew where Reality got its computing power.)

He's expressing, first, a reductionist position. It is indeed an "ism." It proposes itself as what is "really" so (but, to his credit, he qualifies it: as far as we can tell. Setting aside a quibble about "we," that's fine).

He is pointing to a unity, but is describing that unity in terms of present understanding ("elementary particle fields and fundamental forces"). Take out the "really," understand "physics" as a heuristic, a method of making predictions, a map rather than the territory, and I'm right with him, down to capitalizing Reality, because it becomes a proper noun.

A proper noun that happens to have, it seems, amazing "computing power." Now, my question: is this "computing power" intelligent?

If you have an answer, coming from knowledge, I'd love to hear how you know it. I'd answer the question myself, but these comments are already long.

Comment author: shminux 06 November 2012 09:01:00PM 1 point [-]

Now, my question: is this "computing power" intelligent?

I guess we should first agree on what the term "intelligent" means. I do not have a good definition, but let's borrow the one given by Eliezer. It ought to be an instrumentally good one, given that constructing an intelligence (a "friendly" one) is his life's goal:

But relative to the space of low-entropy, highly regular goal systems - goal systems that don't pick a new utility function for every different time and every different place - that negentropy pours through the notion of "optimization" and comes out as a concentrated probability distribution over what an "alien intelligence" would do, even in the "absence of any hypothesis" about its goals.

Now, I assume that your definition would not be identical to his, so feel free to express it here.

Comment author: Abd 07 November 2012 12:19:34AM *  0 points [-]

I guess we should first agree on what the term "intelligent" means.

Smart.

[edit: I didn't see an alternate meaning for what I wrote. I meant that it was smart to check for or seek agreement on the meaning, not that "intelligent" means "smart," a mere synonym.]

I do not have a good definition, but let's borrow the one given by Eliezer. It ought to be an instrumentally good one, given that constructing an intelligence (a "friendly" one) is his life's goal:

But relative to the space of low-entropy, highly regular goal systems - goal systems that don't pick a new utility function for every different time and every different place - that negentropy pours through the notion of "optimization" and comes out as a concentrated probability distribution over what an "alien intelligence" would do, even in the "absence of any hypothesis" about its goals.

Now, I assume that your definition would not be identical to his, so feel free to express it here.

The post refers to a definition, but doesn't state it. A previous post has a definition:

(10) "Intelligence" is efficient cross-domain optimization.

I read this as an ability to "solve problems" efficiently, "cross-domain," i.e., not just in some narrow field. In our discussion, I quote EY as referring to Reality as if it has huge computational ability.

My own thinking has reflected on the "omniscience" and "omnipotence" of God as being almost a tautology: Reality knows all things, and over all things has power.

Reality, however, is not an "artificial intelligence," although artificial intelligence may exist, may be real. If it exists, it is limited by its computational power. The computational power of Reality will necessarily be greater. It may not be unlimited though. The Many Worlds interpretation might extend the power of Reality almost infinitely.

On the other hand, is Reality "efficient"?

I have no confidence in these ideas as "truth," but do see them as possibly useful, in terms of the relationship with Reality that might be fostered by them.

Comment author: shminux 07 November 2012 07:50:24PM 1 point [-]

So, if you agree with EY's definition of intelligence, where do you think you two diverge, him being an atheist and you a Muslim?

Comment author: Abd 07 November 2012 09:57:27PM -1 points [-]

I don't know that we diverge. We have not discussed this. Do remember, above, that I said that the difference between a theist and atheist was only a thin space. It might not even be an important space. However, that could depend on what he means by "atheist" and what I mean by "Muslim," which has been the whole point of this discussion, coming as commentary on EY's "Uncritical Supercriticality."

His post seems to me to be about this problem we have of making assumptions about people and positions from affliiations, and what amount to political responses to real or imagined difference. "The affective death spiral." Thanks, shminux, for the questions you ask, which, in my experience, bring insight.

Comment author: shminux 07 November 2012 11:51:24PM 0 points [-]

Thanks, shminux, for the questions you ask, which, in my experience, bring insight.

You are most welcome, though my assessment of our exchange is less glowing, given that neither of us changed their worldview to any significant degree.

Comment author: Abd 08 November 2012 01:21:51AM -1 points [-]

Give it time.