All of Quinn's Comments + Replies

Quinn
00

Thanks for pointing that out. My feeling is still "well yes, that's technically true, but it still seems unnatural, and explosion is still the odd axiom out".

Coq, for example, allows empty case expressions (for empty types), and I expect that other languages which double as proof assistants would support them as well... for the very purpose of satisfying explosion. General purpose languages like Haskell (and I just checked OCaml too) can seemingly overlook explosion/empty cases with few if any practical problems.

Quinn
Ω120

Thanks for the suggestion, Patrick. I've now adapted Tsvi's formal argument to the reframed "5-equals-10 problem" and added it into the last section of my writeup.

Quinn
260

Because the length of Scott's Moloch post greatly exceeds my working memory (to the extent that I had trouble remembering what the point was by the end) I made these notes. I hope this is the right place to share them.

Notes on Moloch (ancient god of child sacrifice)

http://slatestarcodex.com/2014/07/30/meditations-on-moloch/

  1. Intro - no real content.

  2. Moloch as coordination failure: everyone makes a sacrifice to optimize for a zero-sum competition, ends up with the same relative status, but worse absolute status.

    • 10 examples: Prisoner's Dilemma, dollar auc
... (read more)
0[anonymous]
I came here to complain that I don't understand meditations on moloch at all. Can someone explain the points more explicitly? And you have. Thank you. If: Then those factors are the critical systemic elements of progress. However, is there any reason to believe those are those systemic elements, rather than others?
6kpreid
Isn't a competition in which that outcome is possible not zero-sum, by definition?
8lukeprog
I'm a bit surprised I haven't seen this particular incentives problem named in the academic literature. It is related in different ways to economic concepts like tragedy of the commons, social trap, tyranny of small decisions, and information asymmetry, but isn't identical with or fully captured by any of them.
3Stuart_Armstrong
Yep, a fair summary, with none of the wild poetry :-)
Quinn
10

Cool.

For those who don't want to wait until April 7th, Udacity is scheduled to launch their own Intro to Data Science on Feb 5th (this Wednesday). I expect it to be easier/shallower than the Hopkins/Coursera sequence, but it wins on actionability.

Quinn
10

For a countable language L and theory T (say, with no finite models), I believe the standard interpretation of "space of all models" is "space of all models with the natural numbers as the underlying set". The latter is a set with cardinality continuum (it clearly can't be larger, but it also can't be smaller, as any non-identity permutation of the naturals gives a non-identity isomorphism between different models).

Moreover this space of models has a natural topology, with basic open sets {M: M models phi} for L-sentences phi, so it mak... (read more)

Quinn
00

For the sake of the absent gods do not start with an IDE or anything that hides the compilation step.

Could you say more about why this is important for beginning programmers?

3RolfAndreassen
Because, in my experience, you cannot debug anything more than one step removed from the command line; and if you cannot debug then you cannot program. If you are unable to compile, link, and run your code from the command line then you will not be able to fix it when something goes wrong on a system with a slight difference from your dev setup; and they all have slight differences from your dev setup.
Quinn
60

While you're certainly technically correct, it's an easy/common mistake for people to focus on the "save all you can" part, overlooking "gain all you can" opportunities. The EA movement is notable for proactively trying to counter this mistake, and apparently so is John Wesley.

Quinn
70

For the same reasons you outline above, I'm okay with fighting this hypothetical target.

If I must dignify the hypothesis with a strategy: my "buy" and "sell" prices for such a bet correspond to the inner and outer measures of the target, respectively.

Quinn
130

In other words, "what is the measure of an unmeasurable set?". The question is wrong.

9Oscar_Cunningham
I suppose the question is: What should you do if you're offered a bet on whether the dart will hit the target or not? There's no way to avoid the question other than arguing somehow that you'll never encounter an immeasurable set.
Quinn
180

Several popular comments say something to the effect of "I was too arrogant to just get with the program and cooperate with the other humans".

The biggest of my own arrogant mistakes was not taking CS/programming very seriously while in college because I was dead set on becoming a mathematician, and writing code was "boring" compared to math. Further arrogance: I wasn't phased by the disparity between the number of graduating Ph. D.'s and the number of academic jobs.

I found out in grad school that my level of talent in mathematics, while... (read more)

Quinn
70

GEB will take you from superficial knowledge to full grok.

A word of caution: there is a risk when reading popular science/math books like GEB of coming away feeling like one understands something at a higher level than one actually does, particularly if one hasn't already studied the subject formally.

If one has formally studied incompleteness before, it's easy to wave away standard primitive recursive derivations (e.g. the proof predicate) as tedious and trivial and beside the main point, but having this attitude the first time around could be dangerous... (read more)

4So8res
I agree that GEB should be supplemented with formal study for a deeper understanding. To clarify my anecdote, my "formal study" of incompleteness allowed me to manipulate the symbols, follow the proofs, pass a test, and conclude that incompleteness is something I have to believe. By contrast, GEB showed me incompleteness intuitively. It made incompleteness seem natural and inevitable. It convinced me, instead of forcing my beliefs. ("There's a difference between a proof and a why", as I like to say.) This is likely due in part to the fact that my "formal study" of incompleteness was part of university courses, and was not self-motivated. I like to think I could have gleaned a "why" from the formal proofs -- but I didn't. It wasn't high priority. GEB makes it fun and relatively easy, which is a huge part of its appeal. That said, reading about something is rarely a substitute for hands-on experience.
Quinn
00

Martin Gardner's Mathematical Games column from Scientific American Volume 242, Number 6, June, 1980. Paywalled here:June:1980).

EDIT: escape characters

3VincentYu
Here.
Quinn
10

Robin Hanson has advocated this point of view.

I find the argument quite unconvincing; Hanson seems to be making the mistake of conflating "life worth living" with "not committing suicide" that is well addressed in MTGandP's reply (and grandchildren).

Quinn
70

The 52-karma top comment of the Virtual Employment thread has been deleted. I gather that it said something about copywriting, with online skill tests for prospective applicants.

Can anyone provide a bit more information about this apparently quite valuable comment?

Quinn
30

Thanks for the nice comment. I listed the PD post first, as it is probably the most readable of the three, written more like an article than like notes.

Quinn
00

Thanks for looking! I'll try to get my hands on a physical copy, as the Google Books version has highly distracting page omissions.

Quinn
40

Unless I'm going insane, Luke_A_Somers' comment below is incorrect. If you defect and your opponent times out, you still get 1 point and they get 0, which is marginally better than both getting 1 point in the case of mutual defection.

That was the purpose my (sleep 9). I figured anyone who was going to eval me twice against anything other than CooperateBot is going to figure out that I'm a jerk and defect against me, so I'm only getting one point from them anyway. Might as well lower their score by 1.

My assumption might not have been correct though. In the ... (read more)

Quinn
20

Yes, the "here's why Quinn is wrong about CooperateBot being a troll submission" comments were valuable, so I don't regret provoking them. Presumably if my comment had said "players" instead of "trolls" from the outset, it would have been ignored for being inoffensive and content-free.

But provoking a few good comments was a happy accident from my perspective. I will avoid casual use of the word "troll" on this site, unless I have a specific purpose in mind.

Quinn
10

Yes, and I agree with this. I'm familiar with Straw Vulcanism and accept that guessing incorrectly is my mistake, not others'.

It seems anger and frustration were read into my comment, when in fact I was merely surprised, so I've edited out the offending t-word.

Quinn
00

Ken Binmore & Hyun Song Shin. Algorithmic knowledge and game theory. (Chapter 9 of Knowledge, Belief, and Strategic Interaction by Cristina Bicchieri.)

EDIT: Actually, I'd be pretty happy to see any paper containing both the phrases "common knowledge" and "Löb's theorem". This particular paper is probably not the only one.

3lukeprog
Here.
3gwern
Sorry, can't get it. There's a Google Books version you might be able to use, but the UWash access is only to a physical copy. As for your edit, well, * http://www.google.com/search?q=%22common+knowledge%22+AND+%28%22L%C3%B6b%27s+theorem%22+OR+%22Loeb%27s+theorem%22+OR+%22Lob%27s+theorem%22%29 * http://scholar.google.com/scholar?q=%22common+knowledge%22+AND+%28%22L%C3%B6b%27s+theorem%22+OR+%22Loeb%27s+theorem%22+OR+%22Lob%27s+theorem%22%29 turn up some things that might be useful.
Quinn
-20

Can you elaborate on this?

You are right that I used the inflammatory t-word because CooperateBot submitters are probably not trying to win. I certainly expected to see DefectBots (or CliqueBots from optimists), and agree that the competition should have been seeded with both CooperateBots and DefectBots.

But I don't understand this at all:

But I find this a poor excuse. (It's why I always give the maximum possible number whenever I play "guess 2/3rds of the average.")

To me, this looks like t-wording the people who play 0.

Are we thinking of the ... (read more)

7Qiaochu_Yuan
Yes, that game. My point is that complaining "that's not fair, X player wasn't playing to win" is a failure to think like reality. You know that you're playing against humans, and that humans do lots of things, including playing games in a way that isn't playing to win. You should be taking that into account when modeling the likely distribution of opponents you're going to face. This is especially true if there isn't a strong incentive to play to win.
Quinn
00

I was a bit irritated that no fewer than three players submitted CooperateBot, as I cooperated with it in hopes of tricking bots like submission B.

EDIT: More offense was taken at my use of the word "trolls" than was intended.

2Illano
As one of the people who submitted a CoopBot. I had three primary motivations. The first came from a simulation of the competition I created in Python, where I created copies of a lot of the strategies mentioned in the thread comments (excluding of course the ones with a nebulous perfectlyPredictOpponent() function). Given that a lot of the strategies discussed involved checking for cooperation with a coopBot, playing an actual coopBot ranked relatively highly in my test competitions, failing primarily against random or defectbots, and it seemed less exploitable by higher level bots, if they still wanted to be able to trick the lower level bots. The second motivation was to use the coopBot as a baseline to see how well the other bots really did perform. The third motivation was simple: I don't really know Scheme, so most of my more complex bots from my Python simulation proved too difficult to implement in the time I allocated to work on this.
4wedrifid
Be sure to distinguish the "think you're wrong" and the "find it offensive" components of the responses.
1Decius
There exist LW readers who believe that Cooperate is the dominant strategy in PD.
1wedrifid
Anyone who submits a strategy that cooperates with CooperateBot has no place shaming others as 'trolls' for cooperating. If you are trying to 'trick' others and guess their responses incorrectly then the joke is entirely on you!
8evec
Why does submitting CooperateBot to a competition that does not include it make someone a troll? Would submitting DefectBot make one a troll, too? (I believe the competition should have automatically included one CooperateBot and DefectBot each, and stated that this was the case at the beginning. I am sad there were three CooperateBots and no DefectBots.)
Quinn
20

Of course, when you ignore the payoff matrix, the argument is no longer really about the Prisoner's Dilemma (and so I don't know that it's fair to accuse the barber paradox of having a lot of extra cruft not present in the PD formulation).

But I agree that this is a cute presentation of diagonal arguments in culturally relevant terms. A fun read.

Quinn
40

I'm glad you bring this up. I have two comments:

(1) The absoluteness argument shows that intermediate uses of Choice don't matter. They happen (definably) in L, and the conclusion reflects back up to V.

(2) As you suspect, you don't really need Choice for compactness of the Hilbert cube. Given a sequence in it, I can define a convergent subsequence by repeatedly pigeonholing infinitely many points into finitely many holes. I believe sequential compactness is what is needed for the Kakutani theorem.

Variants of open cover compactness are derivable from sequen... (read more)

Quinn
40

I gave this paper a pretty thorough read-through, and decided that the best way to really see what was going on would be to write it all down, expanding the most interesting arguments and collapsing others. This has been my main strategy for learning math for a while now, but I just decided recently that I ought to start a blog for this kind of thing. Although I wrote this post mainly for myself, it might be helpful for anyone else who's interested in reading the paper.

Towards the end, I note that the result can be made "constructive", in the sen... (read more)

3Qiaochu_Yuan
Note that there's a second sense in which the argument is nonconstructive: Kakutani requires as a hypothesis that the space be compact. In your post you say [0, 1]^{\omega} is compact by Tychonoff's theorem, but using Tychonoff's theorem in its general form here is a use of choice. For compact Hausdorff spaces it's enough to use the ultrafilter lemma, but I believe you can just prove by hand that [0, 1]^{\omega} is compact in ZF.
Quinn
50

The computability problem is due to the unbounded ability of P to reason about theorems in the base theory (so that would be a necessary point of relaxation). A computable total function can't even assign values > 1/2 to all the theorems of PA and values < 1/2 to all the sentences refuted by PA.

Quinn
10

The set A is convex because the convex combination (t times one plus (1-t) times the other) of two coherent probability distributions remains a coherent probability distribution. This in turn is because the convex combination of two probability measures over a space of models (cf. definition 1) remains a probability distribution over the space of models.

I think, but am not sure, that your issue is looking at arbitrary points of [0,1]^{L'}, rather than the ones which correspond to probability measures.

Quinn
20

Not only is PA not finitely axiomatizable, but any consistent extension of PA isn't (I think this is true, the same proof that works for PA should go through here, but I haven't checked the details)

Well if we had this, we would know immediately that Q + Con(PA) is not an extension of PA (which is what we originally wanted), because it certainly is finitely axiomatizable. I know there are several proofs that PA is not finitely axiomatizable, but I have not read any of them, so can't comment on the strengthened statement, though it sounds true.

Quinn
20

Ah, so my question was more along the line: does finite axiomatizability of a stronger (consistent) theory imply finite axiomatizability of the weaker theory? (This would of course imply Q + Con(PA) is not stronger than PA, Q being the usual symbol for Robinson arithmetic.)

On the model theoretic side, I think I can make something work, but it depends on distorting the specific definition of Con(PA) in a way that I'm not really happy about. In any case, I agree that your example is trivial to state and trivial to believe correct, but maybe it's less trivial... (read more)

1[anonymous]
If I'm not mistaken, NBG and ZFC are a counterexample to this: NBG is a conservative extension of ZFC (and therefore stronger than ZFC), but NBG is finitely axiomatizable while ZFC is not.
0JoshuaZ
Yeah, the details of actually proving this are looking like they contain more subtleties than I expected, but I tentatively agree with your analysis. Here's what may be another proof,. Not only is PA not finitely axiomatizable, but any consistent extension of PA isn't (I think this is true, the same proof that works for PA should go through here, but I haven't checked the details). So PA+ConMinus(PA) still isn't finitely axiomatizable. So now, pick any of the axioms created in the axiom schema of induction that are needed in PA + ConMinus(PA), Q+ConMinus(PA) also can't prove any of those (since it is strictly weaker than PA+ConMinus(PA),) but all of those statements are theorems of PA (since they are in fact axioms). Does this work? Overall, this is requiring a lot more subtlety than I initially thought was involved which may make Qiaochu Yuan's example a better one.
Quinn
20

Your post confused me for a moment, because Robinson + Con(PA) is of course not weaker than PA. It proves Con(PA), and PA doesn't.

I see now that your point is that Robinson arithmetic is sufficiently weak compared to PA that PA should not be weaker than Robinson + Con(PA). Is there an obvious proof of this?

(For example, if Robinson + Con(PA) proved all theorems of PA, would this contradict the fact that PA is not finitely axiomatizable?)

2JoshuaZ
Yes, finite axiomatizability is the obvious way of seeing this. You are correct that strictly speaking Robinson + Con(PA) is not weaker than PA, but rather is another incomparable example (which was the intended point). Note that there are other ways of seeing that Robinson + Con(PA) is weaker than PA without using the finite axiomatization of PA if one is willing to be be slightly non-rigorous. For example, one can note that Robinson arithmetic has as a model Z[x]+ so any theorem of Robinson +Con(PA) should be a theorem of Z[x]+ +Con(PA), (this step requires some details).
Quinn
100

Since December, I've been persuing a "remedial computer science education", for the sake of both well-roundedness and employability. My background is in the purest of pure math (Ph. Dropout from a well-ranked program), so I feel I can move fairly quickly here, though the territory is new.

My biggest milestone to date has been solving the first 100 Project Euler problems in Python (no omissions!). I had had a bit of Python experience before, and I picked 100 as the smallest number that sounded impressive (to me).

Second biggest milestone: following ... (read more)

Quinn
290

From Kahneman's Thinking, Fast and Slow (p 325):

The probability of a rare event is most likely to be overestimated when the alternative is not fully specified... [Researcher Craig Fox] asked [participants] to estimate the probability that each of the eight participating teams would win the playoff; the victory of each team in turn was the focal event.

... The result: the probability judgments generated sucessively for the eight teams added up to 240%!

Do you (r_claypool) have reason to suspect that Christianity is much more likely to be true than other, ... (read more)

0r_claypool
No, I've read way more Christian apologetics than I care to admit, and the basic tenants of the Bible like -- "God could find no better way to forgive humans than to have one tortured on a cross" -- are no more substantiated by apologists than whatever is part of Old Norse Paganism. But it still doesn't feel absurdly high.
Quinn
00

But orthonormal, your example displays hindsight bias rather than confirmation bias!

I interpret billswift's comment to mean:

GlaDOS, you should not just seek confirmation of the legitimacy of the text; you should also seek refutation.

(Or possibly it was meant the other way around?)

In any case, I agree that billswift's comment is off-base, because GLaDOS' comment does not actually show confirmation bias.

Quinn
20

I am currently reading Kahneman's book, and about 100 pages in I realized I was going to cache a lot more of the information if I started mapping out some of the dependencies between ideas in a directed graph. Example: I've got an edge from {Substitution} to {Affect heuristic}, labeled with the reminder "How do I feel about it? vs. What do I think about it?". My goal is not to write down everything I want to remember, rather to (1) provide just enough to jog my memory when I consult this graph in the future, and (2) force me to think critically about what I'm reading when deciding whether or not add more nodes and edges.

Quinn
40

Grognor, I don't think it's fair to insinuate that you may have learned a wrong lesson here. If it's wrong (I actually doubt that it is), then it's up to you to try to resist learning it.

As regards walking readers into a trap to teach them lessons, one of my all-time favorite LW posts does exactly this, but is very forthcoming about it. By contrast, I think thomblake overestimates the absurdity of the examples here: I thought they seemed plausible, and that "Frodo Baggins" was just poor reasoning. The comments show I'm not alone here. This level ... (read more)

1thomblake
Done, with appropriate subtlety.
2Grognor
I'm not so sure the lesson is wrong. I'm very confused by this particular meta level, and I don't think this confusion will ever actually be resolved. Edit: but you're right, I implied that this was a bad lesson to learn and shouldn't have done that.
Quinn
250

I really, really dislike April Fool's jokes like this. Somebody will stumble onto this post at a later date, read it quickly, and come away misinformed.

I'll grant that the obviously horrible "Frodo Baggins" example should leave a bad taste in rationalists' mouths, but a glance at the comments shows that several readers initially took the post seriously, even on April 1st.

thomblake
100

The post's own title describes the bias as fictional. It is tagged "aprilfools". All of the citations are, even at a glance, either made up or about different biases. The post is peppered with weasel words in place of real references, like "As it turns out". The comments mention it's an April Fool's gag, and point to related real articles. The examples are completely absurd - and while the absurdity heuristic isn't perfect, "even though appearances can be misleading, they're usually not."

And the effect probably does really exist!

There are several lessons in there...

pnrjulius
110

I agree completely. If you didn't read the references or notice the date, the article seems completely legitimate. It makes a couple weird claims (fictional drugs?), but if you didn't know the literature they wouldn't necessarily seem any stranger than the actual things people do (like anchoring their estimate of a car's value to their social security number). Remember that the absurdity heuristic is not a very good mode of reasoning!

So this means that while people who know Less Wrong can have a little inside joke, people who are new to rationalism and behavioral sciences could easily be fooled.

Quinn
30

I suspect it has to do with some LW users taking FAI seriously and dropping everything to join the cause, as suggested in this comment by cousin_it. In the following discussion, RichardKennaway specifically links to "Taking ideas seriously".

2Kenny
Yikes – "taking FAI seriously" is definitely not an obvious failure or harm!
Quinn
00

Oh! Well I feel stupid indeed. I thought that all the text after the sidenote was a quotation from Luke (which I would find at the link in said sidenote), rather than a continuation of Mike Darwin's statement. I don't know why I didn't even consider the latter.

Quinn
00

Additionally, the link in the OP is wrong. I followed it in hopes that Luke would provide a citation where I could see these estimates.

[This comment is no longer endorsed by its author]Reply
0Synaptic
This was the quote I was referring to: I was referencing how it is difficult to effectively lead an organization that is so focused on the distant future and which must make so many difficult decisions. I should have been clearer.
Quinn
70

Well, models can have the same reals by fiat. If I cut off an existing model below an inaccessible, I certainly haven't changed the reals. Alternately I could restrict to the constructible closure of the reals L(R), which satisfies ZF but generally fails Choice (you don't expect to have a well-ordering of the reals in this model).

I think, though, that Stuart_Armstrong's statement

Often, different models of set theory will have the same model of the reals inside them

is mistaken, or at least misguided. Models of set theory and their corresponding sets of ... (read more)

0Stuart_Armstrong
Thanks for that elucidation.
0cousin_it
Thank you for helping me fill my stupid gap in understanding!
Quinn
90

The predicate "is a real number" is absolute for transitive models of ZFC in the sense that if M and N are such models with M contained in N, then for every element x of M, the two models agree on whether x is a real number. But it can certainly happen than N has more real numbers than M; they just have to lie completely outside of M.

Example 1: If M is countable with respect to N, then obviously M doesn't contain all of N's reals.

Example 2 (perhaps more relevant to what you asked): Under mild large cardinal assumptions (existence of a measurable ... (read more)

2cousin_it
Oh. Thanks. Are there any examples of different models of ZFC that contain the same reals?
Quinn
100

Cached wisdom?

Anyway, I'd be more interested in hearing the regrets of those people who lived true to themselves, didn't work too hard, let themselves be happier, etc. Do they wish they'd worked harder and "made something of themselves"? Been better at cooperating with the rest of society?

Quinn
00

Signed up. Upon reflection, I believe the deadline is what let me get away with doing this right now at the expense of putting off studying for yet another hour. But it's hard to say, because I decided pretty quickly that I was going to do it, and I only came up with that explanation after the fact.

Quinn
00

Actually my revised opinion, as expressed in my reply to Tyrell_McAllister, is that the authors' analysis is correct given the highly unlikely set-up. In a more realistic scenario, I accept the equivalences A~B and C~D, but not B~C.

I claim that the answers to E, F, and G should indeed be the same, but H is not equivalent to them. This should be intuitive. Their line of argument does not claim H is equivalent to E/F/G - do the math out and you'll see.

I really don't know what you have in mind here. Do you also claim that cases A, B, C are equivalent to each other but not to D?

0wuthefwasthat
Oops, sorry! I misread. My bad. I would agree that they are all equivalent.
Quinn
00

After further reflection, I want to say that the problem is wrong (and several other commenters have said something similar): the premise that your money buys you no expected utility post mortem is generally incompatible with your survival having finite positive utility.

Your calculation is of course correct insofar as it stays within the scope of the problem. But note that it goes through exactly the same for my cases F and G. There you'll end up paying iff X ≤ L, and thus you'll pay the same amount to remove just 1 bullet from a full 100-shooter as to remove all 100 of them.

Quinn
00

I also reject the claim that C and B are equivalent (unless the utility of survival is 0, +infinity, or -infinity). If I accepted their line of argument, then I would also have to answer the following set of questions with a single answer.

Question E: Given that you're playing Russian Roulette with a full 100-shooter, how much would you pay to remove all 100 of the bullets?

Question F: Given that you're playing Russian Roulette with a full 1-shooter, how much would you pay to remove the bullet?

Question G: With 99% certainty, you will be executed. With 1% cer... (read more)

0wuthefwasthat
You reject the claim, but can you point out a flaw in their argument? I claim that the answers to E, F, and G should indeed be the same, but H is not equivalent to them. This should be intuitive. Their line of argument does not claim H is equivalent to E/F/G - do the math out and you'll see.
0Tyrrell_McAllister
What do you make of my argument here?
Load More