V_V comments on MIRI's Approach - Less Wrong

34 Post author: So8res 30 July 2015 08:03PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (59)

You are viewing a single comment's thread. Show more comments above.

Comment author: V_V 01 August 2015 06:54:22AM *  0 points [-]

This approach yields increasingly fruitful analyses of such cognitive activities as causal learning, concept learning, and planning in arbitrary environments as probabilistic inference enriched with causal/logical structure.

It's not obvious to me that the Church programming language and execution model is based on bounded rationality theory.

I mean, the idea of using MCMC to sample the executions of probabilistic programs is certainly neat, and you can trade off bias with computing time by varying the burn-in and samples lag parameters, but this trade-off is not provably optimal.

If I understand correctly, provably optimal bounded rationality is marred by unsolved theoretical questions such as the one-way functions conjecture and P != NP. Even assuming that these conjectures are true, the fact that we can't prove them implies that we can't often prove anything interesting about the optimality of many AI algorithms.

Comment author: [deleted] 03 August 2015 03:40:04AM 0 points [-]

It's not obvious to me that the Church programming language and execution model is based on bounded rationality theory.

That's because it's not. The probabilistic models of cognition (title drop!) implemented using Church tend to deal with what the authors call the resource-rational school of thought about cognition.

If I understand correctly, provably optimal bounded rationality is marred by unsolved theoretical questions such as the one-way functions conjecture and P != NP.

The paper about it that I read was actually using statistical thermodynamics to form its theory of bounded-optimal inference. These conjectures are irrelevant, in that we would be building reasoning systems that would make use of their own knowledge about these facts, such as it might be.

Comment author: V_V 09 August 2015 07:42:21PM -1 points [-]

The paper about it that I read was actually using statistical thermodynamics to form its theory of bounded-optimal inference.

Sounds interesting, do you have a reference?

Comment author: [deleted] 09 August 2015 07:52:15PM 1 point [-]

Sure. If you know statistical mechanics/thermodynamics, I'd be happy to hear your view on the paper, since I don't know those fields.

Comment author: V_V 11 August 2015 12:40:08PM -1 points [-]

Thanks, I'll read it, though I'm not an expert in statistical mechanics and thermodynamics.