JGWeissman comments on Without models - Less Wrong

14 Post author: RichardKennaway 04 May 2009 11:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (53)

You are viewing a single comment's thread. Show more comments above.

Comment author: JGWeissman 06 May 2009 06:22:19PM 0 points [-]

Or the model in the designer's head is pointed to, and some sort of contagion invoked to attribute it to the thing he designed. No, this is butter spread over too much bread. That is not what is called a model anywhere on OB or LW except in these comment threads; it is not what is called a model, period.

It is not about contagion. The point is, the reason that a particular control system even exists, as a opposed to a less effective control system or no control system at all, is that a process that implements some level of rationality produced it. The fact that a control system only needs the cached results of past rationality, and does not even have the capacity to execute additional rationality, does not change the fact that rationality plays a role in its effectiveness.

Comment author: Cyan 06 May 2009 08:19:13PM *  0 points [-]

Semantics check: I assert that evidence accumulation does not imply some (non-zero) level of rationality. Ex gratia, evolution by natural selection accumulates evidence without any rationality. Does my word use accord with yours?

Comment author: JGWeissman 06 May 2009 09:17:15PM 0 points [-]

I think of the process of rationality as using evidence to (on average) improve behavior in the sense of using behaviors that produce better results. Evolution is a strange example, in that this process of improvement is not deliberative. It has no model, even metaphorically, that is deeper than "this gene contributes to genetic fitness". It is incapable of processing any evidence other than the actual level of reproductive success of a genetic organism, and even then it only manages to update gene frequencies in the right direction, not nearly the rationally optimal amount (or even as close as deliberative human rationality gets). It is this small improvement in response to evidence that I consider rational (at a very low level). The fact that we can trace the causal steps of the evidence (reproductive fitness) to the improvement at a deep physical level matters only as much as the fact that in principle we could do the same with the causal steps of evidence I observe influencing the neurons in my brain which implements my rationality.

Comment author: Cyan 06 May 2009 09:21:40PM *  0 points [-]

...so that's a "no," then? (I don't think we disagree about what is actually (thought to be) happening, only on the words we'd use to describe it.)

Comment author: JGWeissman 06 May 2009 09:40:47PM 0 points [-]

That is correct. We are using the word differently. What do you mean by "rationality"?

Comment author: Cyan 06 May 2009 11:14:21PM *  0 points [-]

That's a question with a complicated answer, but for the purposes of distinguishing what natural selection does from Cyan::rationality, it involves actions that are planned with an eye to constraining the future.