= 27d567bc2d48d9f40e9ccc20ea370b15)
lukeprog comments on Reflection in Probabilistic Logic - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (171)
I can never quite tell to what extent you are being deliberately inflammatory; is there a history I'm missing?
I agree that this work is only relevant to systems of a certain kind, i.e. those which rely on formal logical manipulations. It seems unjustifiably strong to say that the work is therefore of vanishing importance. Mostly, because you can't justify such confident statements without a much deeper understanding of AGI than anyone can realistically claim to have right now.
But moreover, we don't yet have any alternatives to first order logic for formalizing and understanding general reasoning, and the only possibilities seem to be: (1) make significant new developments that mathematicians as a whole don't expect us to make, or (2) build systems whose reasoning we don't understand except as an empirical fact (e.g. human brains).
I don't deny that (1) and (2) are plausible, but I think that, if those are the best bets we have, we should think that FOL has a good chance of being the right formalism for understanding general reasoning. Which part of this picture do you disagree with? The claim that (1) and (2) are all we have, the inference that FOL is therefore a plausible formalism, or the claim that the OP is relevant to a generic system whose reasoning is characterized by FOL?
I'm also generally skeptical of the sentiment "build an intelligence which mimics a human as closely as possible." This is competing with the principle "build things you understand," and I think the arguments in favor of the second are currently much stronger than those in favor of the first (though this situation could change with more evidence or argument). I think that work that improves our ability to understand reasoning (of which the OP is a tiny piece) is a good investment, for that reason.
Your characterization of the OP is also not quite fair; we don't necessarily care about the strength of the underlying proof system, we are talking about the semantic issue: can you think thoughts like "Everything I think is pretty likely to be true" or can't you? We would like to have a formalism in which you can articulate such thoughts, but in which the normal facts about FOL, completeness theorems, etc. still apply. That is a much more general issue than the problem of boosting a system's proof-theoretic strength in order to boost its reasoning power.
IIRC, Eliezer banned Richard from SL4 several years ago. I can't find the thread in which Eliezer banned him, but here is a thread in which Eliezer writes (to Richard) "I am wondering whether to ban you from SL4..."
After a few counter-productive discussions with Richard, I've personally stopped communicating with him.
The "bannination" is here.
EDIT: and here is Eliezer's explanation.
Note that I've personally had many productive discussions with Richard: he does have a bit of a temper, which is compounded by a history of bad experiences with communities such as SL4 and this one, but he's a very reasonable debate partner when treated with courtesy and respect.
It says something profound about the LessWrong community that:
(a) Whenever I post a remark, no matter how innocent, Luke Muehlhauser makes a point of coming to the thread to make defamatory remarks against me personally ..... and his comment is upvoted;
(b) When I, the victim of Muehlhauser's attack, point out that there is objective evidence to show that the defamation is baseless and unjustified .... my comment is immediately downvoted.
It says something profound about the ten or so people who have voted on your recent comments, assuming none of the votes come from the same person.
I was not aware of the prior history, but I tend to downvote anyone coming across as a bitter asshole with an ax to grind.
Ditto. I hypothesise that if Richard had used a few different words here and there to take out the overt barbs he may have far more effectively achieved his objective of gaining the moral high ground and making his adversaries look bad.
I'd rather not phrase it in terms of adversaries but the basic point that people would be more inclined to listen to Richard if he was less combative is probably accurate.
The above is an extraordinarily good example of why lukeprog no longer talks to you.