All of Christian_Szegedy's Comments + Replies

In order to define the semantics,... This isn't precise enough for me to agree that it's true. Is it a claim? A new definition?

First: sorry for the bad grammar! Let me start with rephrasing the first sentence a bit more clearly:

"In order to define semantics, we need to define a map between the logic to the model ...."

It is correct that this description constrains semantics to maps between symbolically checkable systems. Physicists may not agree with this view and could say: "For me, semantics is a mapping from a formal system to a physi... (read more)

[This comment is no longer endorsed by its author]Reply

The overall message is not really new technically, but its philosophical implications are somewhat surprising even for mathematicians. In general, looking at the same thing from different angles to helps to get acquire more thorough understanding even if it does not necessarily provide a clear short term benefit.

A few years ago, I chatted with a few very good mathematicians who were not aware (relatively straightforward) equivalence between the theorems of Turing and Goedel, but could see it within a few minutes and had no problem grasping the the inheren... (read more)

2Jonathan_Graehl
An admirable response. Here's the first place you lost me: This isn't precise enough for me to agree that it's true. Is it a claim? A new definition? Next: I took "axiom system" to mean a set of axioms and rules for deducing their consequences (I know you probably mean the usual first-order logic deduction rules). What do you mean? Are you talking about something other process than the proof checking program? I'll wait for clarifications on those points before proceeding.

I expected the reaction with the countably infinite models, but I did not expect it to be the first. ;)

I wanted to get into that in the write up, but I had to stop at some point. The argument is that in order to have scientific theories, we need to have falsifiability, which means that this always necessarily deals with a discrete projection of the physical world. On the other hand so far every discrete manifestation of physical systems seemed to be able to be modelled by Turing machines. (This assumption is called the Church thesis.) If you add these two,... (read more)

0Jonathan_Graehl
I know that material, but couldn't figure out how your informal descriptions map to it in every case. (When following a proof, I like to make sure I understand every step, and fix problems before proceeding). If this isn't intended as new, then I won't sweat it.

The object of life is not to be on the side of the majority, but to escape finding oneself in the ranks of the insane.

Marcus Aurelius

I agree with you. I also think that there are several reasons for that:

First that competitive games are (intellectual or physical sports) easier to select and train for, since the objective function is much clearer.

The other reason is more cultural: if you train your child for something more useful like science or mathematics, then people will say: "Poor kid, do you try to make a freak out of him? Why can't he have a childhood like anyone else?" Traditionally, there is much less opposition against music, art or sport training. Perhaps they are vi... (read more)

I found the most condensed essence (also parody) of religious arguments for fatalism in Greg Egan's Permutation City:

Even though I know God makes no difference. And if God is the reason for everything, then God includes the urge to use the word God. So whenever I gain some strength, or comfort, or meaning, from that urge, then God is the source of that strength, that comfort, that meaning. And if God - while making no difference - helps me to accept what's going to happen to me, why should that make you sad?

Logically irrefutable, but utterly vacuous...

2Nisan
I would have agreed wholeheartedly with that paragraph two years ago.

You should not take the statement too literally: Look it in a historical context. Probably the biggest problems at Russel's time were wars caused by nationalism and unfair resource allocation due to bad (idealistic/traditionalist) policies.. Average life expectancy was around 40-50 years. I don't think anyone considered e.g. a mortality a problem that can or should be solved. (Neither does over 95% of the people today). Population was much smaller. Earth was also in a much more pristine state than today.

Times have changed. We have more technical issues tod... (read more)

I just find it a bit circular that you want evidences for the assertion saying that assertions need evidences.

3Psychohistorian
That is not what circular means. If I say, "All claims need supporting evidence," then I am being inconsistent if I cannot provide evidence for that claim. Circular would be, "All claims require evidence. We know this, because without evidence, you cannot make a proper claim."
5simplicio
Russell is not just saying that beliefs should be proportional to evidence (if anyone on LW disagrees with THAT, I'll be shocked); he's saying that if that were done, it would eliminate most of the world's problems. If he had said 'many' instead of 'most,' it would be a great quote. Unfortunately there is a huge class of problems that, although they may eventually be solved by rational methods, are not solved just by being rational. Turning everyone rational overnight doesn't automatically cure death, for example. Nor does it remedy the partiality of human utility functions, or cure psychopaths of their psychopathy... et cetera.
2ata
The original quote made a much stronger claim than merely "assertions need evidence".

I'd prefer Sunday or Saturday (9/5 would work for me.)

1Jayson_Virissimo
I am very uncertain about the truth of the proposition, so I would like to hear arguments in favor of or against it to develop a more informed opinion.

Did you try GNU Go? That should be hard enough for most beginners.

The problem with GNUgo is that it teaches a style that would not be effective in beating humans. Generally, you have to build up moderately difficult situations, where you have a deep sequence of forcing moves. These kind of deep but simple to prune trees are very easily read by humans, but GNUgo sucks at them, especially if they are on the interaction boundary of bigger fights.

Still it can be valuable learning tool, but one will learn a different skill set to playing with humans.

Let me advertise my absolute favorite: an obscure Hungarian writer called Geza Csath. He was a doctor and journalist at beginning of the 20th century and he wrote the most beautiful and objective stories on self-deception and other human weaknesses. Highly accurately, without moralizing or romanticizing.

I've only read the originals, but I hope the translation is not too bad. (Unfortunately, in English, it is available only used: http://www.amazon.com/Magicians-Garden-Other-Stories/dp/0231047320/ref=sr_1_4?s=books&ie=UTF8&qid=1281569193&sr=1-4... (read more)

I think it is mostly hopeless trying to teach rationality to most people.

For example, both of my parents studied Math in university and still have a very firm grip of the fundamentals.

I just got a phone call yesterday from my father in Germany saying: "We saw in the news, that a German tourist couple got killed in a shooting in San Francisco. Will you avoid going out after dark?" When I tried to explain that I won't update my risk estimates based on any such singular event, he seemed to listen to and understand formally what I said. Anyhow, he was completely unimpressed, finishing the conversation in an even more worried tone: "I see, but you will take care, won't you?"

"don't worry - that sort of thing is so rare, when it happens, it makes the news!"

nerzhin140

Your parents aren't saying "Please update your estimate of the probability of your violent death, based on this important new evidence."

The are saying, "I love you."

This has nothing to do with how rational or irrational they are.

He he, poor WW2 veterans miss the deadline by just one year:

2044 - The last veterans of WW2 are passing away

2045 - Humans are becoming intimately merged with machines

3byrnema
When I'm (physically) driving down the street, I'd like to be able to right-click on a tree I see and find out what kind of tree it is. And who planted it (e.g., federal or state funds) and when, if I want to know. I can't wait till then.

2031 – Web 4.0 is transforming the Internet landscape

Could be funny, if it was a joke... :(

That's true.

But the parallel was a bit more specific: "Good sense of humor" (which he concretely brought up as the most typical example) is an attribute one can easily claim to have as it is impossible to measure.

You missed my point. (Which you would not have, if you had read The Upside of Irrationality by Dan Ariely, an excellent book.)

0ratdreams
Hm, isn't he saying that unattractive people claim they value attributes other than physical attractiveness when selecting a mate? If that's what you're referring to, hilarious. If not, speak more slowly next time. : )

This sounds like "I am not very good looking, but have a great sense of humor." ;)

0ratdreams
: ) More like: I'm not stunning, just ordinary good looking, and I also have a great sense of humor. I didn't say I was stupid, just not a genius.

... and different to almost any other unproven technology (for the exact same reason).

There are a lot of alternatives to fusion energy and since energy production is a widely recognized societal issue, making individual bets on that is not an immediate matter of life and death on a personal level.

I agree with you, though, that a sufficiently high probability estimate on the workability of cryonics is necessary to rationally spend money on it.

However, if you give 1% chance for both fusion and cryonics to work, it could still make sense to bet on the latter but not on the first.

1[anonymous]
Don't read too much into my fusion analogy; you're right that cryonics is different than fusion.

I think one of the reasons this self-esteem seeding works is that identifying your core values makes other issues look less important.

On the other hand, if you e.g. independently expressed that God is an important element of your identity and belief in him is one of your treasured values, then it may backfire and you will be even harder to move you away from that. (Of course I am not sure: I have never seen any scientific data on that. This is purely a wild guess.)

In my reading, the assessment was funny exactly because it was emotional and therefore biased. That's what use of "son of a bitch" suggested as well.

3Rain
Emotion drives value and purpose; logic is compatible with emotion; Spock is a bad example for rationalists.

I am stunned by the relatively high mod-points of this exchange.

I agree that the quotes are moderately funny. (Albeit the M.S. quote was much more funny in the specific context within the game, but even there it was his white-wash response to an action that earned Shepard renegade points.)

Still, I can't see, how all this is related to the "art of human rationality"...

3fortyeridania
It's related because it portrays someone disregarding the omission/commission distinction. Among consequentialists (who seem to be quite common on LW), how something happens is not directly relevant to its moral value. Untutored intuition, in contrast, seems to say that killing is worse than letting die. Therefore, if consequentialism is right about this, then many humans' moral intuitions are wrong in a predictable way. Thus they are biased. Thus they are irrational. Thus this is related to the art of human rationality.
6Rain
"Killing is wrong, no matter what," is a very powerful and standard meme for heroes. It is counter intuitive for someone who "loves people" to kill someone. It requires a less-biased assessment of expected utility than is typically performed. That's why I enjoyed the original quote; in the context of the movie, it made sense in the way of typical human failings for him to say no, and his body language and tone highly suggested he would do so right until the end.

I think, the quote is useless and in rooted in a fundamental misunderstanding of IT.

E.g. experimental mathematics would not exist without computers. Computer simulation is fantastic way to empirically produce and check hypotheses.

Why do you care? You should not follow it anyways. ;)

This is already exploited on cell phones to some extent.

We don't need anyone to tell us what to do. Not Savonarola, not the Medici. We are free to follow our own path. There are those who will take that freedom from us, and too many of you gladly give it. But it is our ability to choose- whatever you think is true- that makes us human...There is no book or teacher to give you the answers, to show you the way. Choose your own way! Do not follow me, or anyone else.

(Assassin's Creed II, Ezio Auditore's speech)

5SilasBarta
Okay, I'll choose my own way. What else does Auditore say I should do?

Rationalists should win

I hate to see this clever statement to be taken out of context and being reinterpreted as a moralizing slogan.

If you trace it back, this was originally a desideratum on rational thinking, not some general moral imperative.

It plainly says that if your supposedly "rational" strategy leads to a demonstrably inferior solution or gets beaten by some stupider looking agent, then the strategy must be reevaluated as you have no right to call it rational anymore.

5LucasSloan
I can't think of a more general moral imperative than "successfully do things you want to do."

In my reading it means, that there are already actual implementations for all probability inference operations that the authors consider in the book.

This has been probably a true statement, even in the 60'ies. It does not mean that the robot as a whole is resource-wise feasible.

An analogy: It is not hard to implement all (non-probabilistic) logical derivation rules. It is also straightforward to use them to generate all true mathematical theorems (e.g. within ZFC). However this does not imply that we have an practical (i.e. efficient) general purpose math... (read more)

Sorry for the confusion. I was very superficial. Of course, your are correct about being able to simplify out those values.

Actually, solving SAT problems is just the simplest case. Even so, if you have only certain variables (with either 0 or 1 plausibility), it's still NP-complete, you can't just simplify them in polynomial time. [EDIT: This is wrong as Jonathan pointed it out.]

In extreme case, since we also have the rule that "robot" has to use all the available information to the fullest extent, it means that the "robot" must be insanely powerful. For example if the calculation of some plausibility value depends for example the correctness of an algorith... (read more)

0Jonathan_Graehl
I think you misunderstood. The robot has a real number p(v) for every v. Let's grant an absolute min and max of 0 and 1. My point was simply that when p(v)=0 or p(v)=1, v can be simplified out of propositions using it. I understand why computing the probability of a proposition implies answering whether it's satisfiable.

Yes, I've read that (pretty good) book quite a while ago and it is also referenced in the TED talk I mentioned.

This was one of the reasons I was surprised that there is still such a huge disagreement about the figures even among experts.

Sorry, I never tried to imply that an AI built on the Bayesian principles is impossible or even a bad idea. (Probably, using Bayesian inference is a fundamentally good idea.)

I just tried to point out that easy looking principles don't necessarily translate to practical implementations in a straightforward manner.

I think it is impossible to decide this based on Chapter 1 alone, for the second criterion (qualitative correspondence with common sense) is not yet specified formally.

If you look into Chapter 2, the derivation of the product rule, he uses this rubber-assumption to get the results he aims for (very similarly to you).

I think one should not take some statements of the author like ("... our search for desiderata is at an end... ") too seriously.

In some sense this informative approach is defensible, from another perspective it definitely looks quite pretentious.

These are perfectly valid arguments and I admit that I share your skepticism concerning the economic competitiveness of the fusion technology. I admit, if I had a decision to make about buying some security, the payout of which would depend on the amount of energy produced by fusion power within 30 years, I would not hurry to place any bet.

What I lack is your apparent confidence in ruling out the technology based on the technological difficulties we face at this point in time.

I am always surprised how the opinion of so called experts diverges when it comes... (read more)

3cousin_it
Ask and ye shall receive: David MacKay, Sustainable energy without the hot air. A free online book that reads like porn for LessWrong regulars.

Funny, I've been entertaining the same idea for a few weeks.

Every time I read statements like "... and then I update the probabilities, based on this evidence ...", I think to myself: "I wish I had the time (or processing power) he thinks he has. ;)"

Imagine what people must have thought in 1910 about the feasibility of getting to the Moon or generating energy by artificially splitting atoms (especially within the 20th century).

2JoshuaZ
Two problems with that sort of comparison: First, something like going to the Moon is a goal, not a technology. Thus, if we have other sources of power, the incentive to work out the details for fusion becomes small. Second, one shouldn't forget how many technologies have been tried and have fallen by the wayside as not very practical or not at all practical. A good way of getting a handle on this is to read old issue of something like Scientific American from the 1950s and 1960s. Or read scifi from that time period. One of example of historical technology that never showed up on any substantial scale is nuclear powered airplanes, despite a lot of research in the 1950s about them. Similarly, nuclear thermal rockets have not been made. This isn't because they are impossible, but because they are extremely impractical compared to other technologies. It seems likely that fusion power will fall into the same category. See this article about Project Pluto for example.

Speaking of Chapter 1, it seems essential to point out another point that may be unclear on superficial reading.

The author introduces the notion of a reasoning "robot" that maintains a consistent set of "plausibility" values (probabilities) according to a small set of rules.

To a modern reader, it may make the impression that the author here suggests some practical algorithm or implementation of some artificial intelligence that uses Bayesian inference as a reasoning process.

I think, this misses the point completely. First: it is clear t... (read more)

0Morendil
What then do you make of Jayne's observation in the Comments: "Our present model of the robot is quite literally real, because today it is almost universally true that any nontrivial probability evaluation is performed by a computer"?
0Jonathan_Graehl
I assume you mean in the sense that deciding satisfiability of arbitrary propositions (over uncertain variables; certainly true/false ones can be simplified out) is NP-complete. Of course I mean that a variable v is uncertain if 0<p(v)<1.
2xamdam
I agree that Jaynes is using the robot as a literary device to get a point across. If I understood you correctly it seems you're sneaking an additional claim that a Bayesian AI is theoretically impossible due to computational concerns. That should be discussed separately, but the obvious counterargument is that while, say, complete inference in Bayes Nets has been proved intractable, approximate inference does well on good-size problems, and approximate does not mean it's not Bayesian.

Your numbers seem to be off: (e.g. 4.26e9 J/sec would be truly minsiscule) You probably meant 4.29e29 J/sec, but then 5.74e5 years are wrong. According to wikipedia, the Sun's energy output is: 1.2e34 J/s which is still at odd with both of your numbers.

I think one should learn on different levels at the same time:

If you only do what's convenient, your progress stops.

If you don't revisit the basics from time to time, you build on sand.

It is necessary to challenge oneself and at the same time work on the fundamentals. It is both inspiring and necessary to strike the right balance between the two extremes: A constant back and forth between them proved to be both the most productive and most entertaining for me personally.

This is the reason I am also interested in this study group: For me, it is revisiting ... (read more)

5Vladimir_Nesov
This should be engraved somewhere in big letters.

I think some interactive discussion would definitely help to keep up the spirit.

I'd definitely be interested in joining a real time discussion if there is enough substance for an clear agenda. Using IRC with pidgin-latex sounds good to me.

It is also not strictly necessary that everybody participates at the same time: we could have two meetings, for two different time zones discussing the same topic.

I think this could be a fun project.

Besides IRL (which is hard to organize) I think other real time communication could be tried out as well. What do you think about the following options:

  • Traditional IRC
  • Google wave
  • Skype conference call
  • Realtime desktop sharing (e.g. mikogo up to 10 participants.)

Does anyone know a good IRC infrastructure that allows for quickly entering and displaying TeX formulas?

2Risto_Saarelma
I've set up an experimental Google Wave for this with Morendil. Eqygadget seems to be able to render Latex input in the Wave. I can add people to the Wave so you can take a look. Just give your Wave account id here, on the #lesswrong IRC channel or mail it to rsaarelm at the Gmail.
4Morendil
Other LWers have used IRC before, so that would be a good option to prolong our discussions. The difficulty I anticipate is dealing with time zones. People who have responded to the post are from all over the map.
2nhamann
Google Wave could be excellent for this, because it acts in part as a wiki (as well as a bunch of other things), meaning we could archive our discussions and come back to them. Also, it has Latex, which is probably necessary.
0RobinZ
Any thoughts on an appropriate IRC host?
8Kazuo_Thow
There's a plugin for Pidgin called pidgin-latex which handles just that. ETA: If people start using this plugin (or, more generally, if we use TeX/LaTeX in any capacity for this study group), it might occasionally be helpful to use the detexify handwritten symbol recognizer - for when you want to use a symbol and can't quite remember the command that produces it.

I've already read the book (the published paper version) without solving the exercises.

I'd be interested in participating in a technical discussion. Maybe (but not very probably) even IRL (Bay Area).

I can attest the being Christian itself does not seem to make a negative difference. :D

2Blueberry
Upvoted. That took me a minute to get.

For me, the eye opener was this outstanding paper by E.T. Jaynes:

http://bayes.wustl.edu/etj/articles/well.pdf

IMO this describes the essence of the difference between the Bayesian and frequentist philosophy way better than any amount of colorful polygons. ;)

I think the only reasonable interpretation of the text is clear since otherwise other standard problems would be ambiguous as well:

"What is probability that a person's random coin toss is tails?"

It does not matter whether you get the information from an experimenter by asking "Tell me the result of your flip!" or "Did you get tails?". You just have to stick to the original text (tails) when you evaluate the answer in either case.

[[EDIT] I think I misinterpreted your comment. I agree that Daniel's introduction was ambiguous for... (read more)

6DanielVarga
Yesterday I told the problem to a smart non-math-geek friend, and he totally couldn't relate to this "only reasonable interpretation". He completely understood the argument leading to 13/27, but just couldn't understand why do we assume that the presenter is a randomly chosen member of the population he claims himself to be a member of. That sounded like a completely baseless assumption to him, that leads to factually incorrect results. He even understood that assuming it is our only choice if we want to get a well-defined math problem, and it is the only way to utilize all the information presented to us in the puzzle. But all this was not enough to convince him that he should assume something so stupid.

There are optimization problems where a bottom-up approach works well, but sometimes top-down or in most cases not so easily labeled methods are necessary.

If mathematical optimization is a proper analogy (or even framework) for solving social/ethics etc. problems, then the logical conclusion would be: The approach must depend heavily on the nature of the problem at hand.

Locality has its very important place, but I can't see how one could address planet-wide "tragedy of the commons"-type issues by purely local methods.

We already have these buttons on LessWrong... ;)

3cousin_it
Karma does make me feel important, but when it comes to happiness karma can't hold a candle to loud music, alcohol and girls (preferably in combination). I wish more people recognized these for the eternal universal values they are. If only someone invented a button to send me some loud music, alcohol and girls, that would be the ultimate startup ever.
Load More