Lumifer comments on Blind Spot: Malthusian Crunch - Less Wrong

4 Post author: bokov 18 October 2013 01:48PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (184)

You are viewing a single comment's thread. Show more comments above.

Comment author: bokov 18 October 2013 09:49:58PM *  1 point [-]

Why don't you think normal market mechanisms (the more scarce resource X is, the higher its price, the larger the incentives to use less, the more intense search for its replacement) will handle the problem?

  • "The market will handle it" is a curiousity killer rather than an explanation, no different from "God will provide". How will the market handle it? Why hasn't it done so already? How long will it take? Is it possible for the market to fail? How do we estimate the chances of failure?

  • If a bias or blind spot is widespread enough, the market will not be immune to it either.

  • The market is just another optimization process. A useful and successful one most of the time, but not to be blindly trusted any more than any other optimization process (especially an optimization process that is not understood).

  • Markets are prone to optimizing over a short time window. The human race won't just spontaneously opt to take the equivalent of a 10-year pay-cut to avoid dying horribly on year 11.

  • Markets are not invincible. They can fail to keep up with events. They may systematically under- or over-value certain items. There might simply not be an adequate solution in the part of the solution-space that is accessible by a market.

  • Hiding in the phrase "more intense search for its replacement" is an unknown unknown. If estimating how and whether the market will handle the problem depends on estimating the outcomes and timescales of ongoing research, that doesn't inspire much optimism.

Am I saying that the UN or some government should step in with resource quotas and compulsory sterilization? No, because centralized bureaucracies have an even worse track record. I'm just saying that magical thinking compromises our problem solving abilities, and "we are in trouble if one of us doesn't soon come up with a better plan to accelerate technology and/or limit population" is a more productive state of mind than a comforting black box like "the markets will handle it".

How about AI? Do you think normal market mechanisms (the more people want to not be turned into paperclips the larger the incentive to make a friendly AI) can be trusted to handle the friendly AI problem?

Comment author: Lumifer 18 October 2013 11:20:51PM *  3 points [-]

"The market will handle it" is a curiousity killer rather than an explanation

Nope, it's neither (unless you think of the market as magical, a surprisingly popular attitude).

In this context it's a forecast, a prediction of what will happen when some resource X becomes scarce. The market is a particular mechanism in a human society and "the market will handle it" is an assertion about allocation of resources under specific conditions.

No one is saying that the markets are "invincible" or any other nonsense like that. However if you look at empirical evidence aka history, the markets helped human societies adapt and flourish in a wide variety of conditions, most of which were characterized by scarcity of some resources.

Given this, I am happy to have "the markets will handle this" as my prior.

If you think that in this particular case there will be a market failure, please provide arguments and evidence. If you think that there is a better alternative, please name it and again, provide arguments and evidence why it's better.

Otherwise you're just engaging in a nirvana fallacy.

Comment author: bokov 19 October 2013 02:50:39AM 1 point [-]

However if you look at empirical evidence aka history, the markets helped human societies adapt and flourish in a wide variety of conditions, most of which were characterized by scarcity of some resources.

So? The two broad defaults for responding to scarcity are trade and violence, history has plenty of examples of both, and polities that were successful at either will be more thoroughly documented in history due to survivor bias.

Nevertheless, every complex civilization previous to ours eventually failed and collapsed. If markets explained their success, do market failures explain their demise? What reason do you have to be so confident that ours has nothing to worry about?

Comment author: Eugine_Nier 21 October 2013 12:19:09AM 2 points [-]

Well, the economy of the Roman Empire collapsed when Diocletian undermined the markets by imposing price controls.

Comment author: ChristianKl 19 October 2013 02:29:18PM 0 points [-]

Nevertheless, every complex civilization previous to ours eventually failed and collapsed. If markets explained their success, do market failures explain their demise?

What do you mean with civilisation in that sentence? Are you refering to Fermi or are you taking about human civilisations?

Comment author: bokov 21 October 2013 09:54:49PM -1 points [-]

In this context, individual human civilizations.

Comment author: Lumifer 19 October 2013 02:59:06AM 0 points [-]

Nevertheless, every complex civilization previous to ours eventually failed and collapsed.

Humanity is still here and looks pretty complex to me :-) Individual civilizations come and go, sure, but that's not the question we're discussing. If e.g. the Western civilization collapses, there will be others ready and willing to take its place.

Comment author: bokov 21 October 2013 09:53:42PM 0 points [-]

Actually, for the first time in history, we might have achieved a global civilization, as well as a global single point of failure.

Comment author: mwengler 19 October 2013 06:11:42PM -1 points [-]

Nope, it's neither (unless you think of the market as magical, a surprisingly popular attitude).

How well did the market handle real estate in the mid 2000's? How well did it handle tech stocks in 1999? Tulip bulbs back in the day?

Who thinks it is magic?

Comment author: gwern 19 October 2013 07:17:39PM 3 points [-]

How well did the market handle real estate in the mid 2000's?

Sumner likes to point out that in many countries which were claimed to be 'bubbles', the bubble never popped. Also true of many regions in the USA - how's that SF bubble going?

How well did it handle tech stocks in 1999?

How high are the stock prices of Amazon, Google, and Apple now? Oh look, Bitcoin is at $160, how did that happen when everyone knew it was a bubble which popped?

Tulip bulbs back in the day?

Everything you know about Tulipomania is false or incomplete. I suggest reading Famous First Bubbles.

Comment author: mwengler 21 October 2013 03:20:06PM 2 points [-]

gwern, I find your position against bubbles to be incredibly unlikely, and that is post my studying economics and finance informally for the last 3 decades. But you are gwern who my post (as opposed to my prior) warns me against dismissing.

If you can suggest any reading that you found particularly compelling against the usual interpretation of market manias, I'd love to take a look. I will google Famous First Bubbles, haven't done that yet.

As far as real estate bubble, first I would point at Mortgage Backed Securities (MBS) rather than the direct real estate market. These were rated AAA, insured for less than a penny on the dollar, and purchased by ancient and venerable banks and others. And then in 2007/2008 they almost uniformly as a class blew up. Returned pennies on the dollar. Caused multiple firms and banks around the world to go bankrupt. Resulted in governments around the world pumping trillions of dollars of liquidity into the system in a process analagous to foaming the runway when a plane crashes. And the essence of it predicted publicly by many of the smartest minds in finance and investing. I am thinking of Buffett and Munger referring to MBS derivatives as Weapons of Financial Mass Destruction BEFORE the blowup, and I had in print in a book printed before the destruction a speecy by Munger talking about how there was going to be a tremendously horrible event because of derivatives "in the next 5 to 10 years" in a speech he gave in I think 2002. While MBS were hot, they were so in demand that brokers such as Salomon would create "synthetic" MBS, which were essentially just well documented bets that would pay off exactly as an MBS would pay off over their life, but were made up because there was still demand for MBS even after the last homeless person with a pulse in the US had been given a 100% non-doc mortgage to buy a house which would not be sellable for even 80% of what was financed two years later.

Is even this not a bubble? Not the market chasing a dream instead of a business proposition and trying to fly up to heaven with the dream and failing?

How high are the stock prices of Amazon, Google, and Apple now? Oh look, Bitcoin is at $160, how did that happen when everyone knew it was a bubble which popped?

The NASDAQ composite peaked in early 2000 at over 4000. More than 13 years later it is STILL not back up to that level. Perhaps at least some of the investors in AMZN and AAPL in 1999 were not caught in a bubble, but what about the bulk of the money, of which about 70% of the value evaporated in less than 3 years, and which on the whole has not crept back up to even yet? And the NASDAQ composite is not the only place to find this result, CSCO, INTC, and QCOM were all bid up much higher in 2000 than they are selling for even now. Proof that they were overvalued in 2000, no? By a factor of a few? I'd like to know the error I make when I think of this as a bubble, as momentum overshooting value and rationality by a factor of a few?

Comment author: Larks 28 October 2013 02:53:56AM 1 point [-]

Mortgage Backed Securities (MBS) ... returned pennies on the dollar.

No, the AAA rates MBS did very well; 90% suffered no loses. It was the ABS CDOs (Asset Backed Security Colateralised Debt Obligations) that did badly.

source: Why did so many people make ex post bad decisions

Comment author: mwengler 28 October 2013 09:55:35PM 0 points [-]

No, the AAA rates MBS did very well; 90% suffered no loses. It was the ABS CDOs (Asset Backed Security Colateralised Debt Obligations) that did badly.

Indeed the data you cite shows that it was Aaa rated CDOs that had default rates about 90%. CDOs were backed by mortgages as well.

Extending what you say about MBS to some more accurate statements, the AAA rated MBS had about a 9% or 10% default rate out to 4 years. There are 26 more years of life in those mortgages in which they can still default, going to an even higher cumulative default rate potentially.

Characterizing a 9% default rate on triple-A securities as "did very well" is quite wrong. Historically, triple-A corporate bonds default at 0.6% or less rate, and triple-A municipals default at 0.00% rate. A 9% default rate 15 times higher than the ratings were intended to suggest. And the Baa MBS defaulted at over 80% rate, more than 15 times the ~5% rate on Baa Corporate bonds prior to 2007.

The ratings were CRAP, suggesting a default rate which should have been 1 to 2 orders of magnitude lower.

Comment author: Larks 29 October 2013 12:55:21AM 1 point [-]

The ratings aren't intra-class independent. Which is perfectly normal; junk corporate failures are correlated too.

Comment author: gwern 21 October 2013 04:06:06PM *  1 point [-]

gwern, I find your position against bubbles to be incredibly unlikely, and that is post my studying economics and finance informally for the last 3 decades.

(Forgive me when I read this mentally as "And that is post my being a random Internet pundit for decades".)

As far as real estate bubble, first I would point at Mortgage Backed Securities (MBS) rather than the direct real estate market. These were rated AAA, insured for less than a penny on the dollar, and purchased by ancient and venerable banks and others. And then in 2007/2008 they almost uniformly as a class blew up. Returned pennies on the dollar. Caused multiple firms and banks around the world to go bankrupt.

I don't think it's very useful to define a 'bubble' as "any large price increase followed by a price decrease".

I'd rather use a more powerful EMH-focused definition: a bubble is large price increase which represents an inefficiency in the market which is predictable in advance (not in hindsight), exploitable, and worth exploiting. Merely pointing out some disaster, or some large price decrease, does not demonstrate the existence of bubbles, because that observation could result from unavoidable or unobjectionable causes like the inherent consequences of risk-taking, mistaken analyses, perverse incentives, etc.

People make mistakes; disasters happen. If they never happened, and AAA never went bust, couldn't one make a lot of money by exploiting that inefficiency in the market and picking up pennies in front of the non-existent steamroller?

I am thinking of Buffett and Munger referring to MBS derivatives as Weapons of Financial Mass Destruction BEFORE the blowup, and I had in print in a book printed before the destruction a speecy by Munger talking about how there was going to be a tremendously horrible event because of derivatives "in the next 5 to 10 years" in a speech he gave in I think 2002. While MBS were hot, they were so in demand that brokers such as Salomon would create "synthetic" MBS, which were essentially just well documented bets that would pay off exactly as an MBS would pay off over their life, but were made up because there was still demand for MBS even after the last homeless person with a pulse in the US had been given a 100% non-doc mortgage to buy a house which would not be sellable for even 80% of what was financed two years later.

How much money did Munger & Buffet make off their shorts of housing, exactly? How much has Paulson made post-housing? (Does making billions off housing, and then losing billions on gold & China, look more like skill & inefficient markets or luck & selection effects?) How many economists did one hear of post-2008 who suddenly turned out to be Cassandras? You can go onto Bitcoin forums and tech websites right now, and watch people predict 20 out of the last 3 Bitcoin 'bubbles'. Finance is just the same. Post hoc selection of people warning something vaguely similar (derivatives? that's a rather roundabout way of predicting a housing bubble, which could have been powered by all sorts of financial instruments, not just derivatives) is worthless.

Is even this not a bubble? Not the market chasing a dream instead of a business proposition and trying to fly up to heaven with the dream and failing?

Housing prices in SF, Australia, London, Canada, Manhattan, China are holding steady at bubblelicious prices or trying to fly up to heaven. (Again, I borrow this point from Sumner.) Perhaps they are using technology from the Apollo program.

The NASDAQ composite peaked in early 2000 at over 4000. More than 13 years later it is STILL not back up to that level. Perhaps at least some of the investors in AMZN and AAPL in 1999 were not caught in a bubble, but what about the bulk of the money, of which about 70% of the value evaporated in less than 3 years, and which on the whole has not crept back up to even yet?

Why is this not just mistaken beliefs about the value of those loser companies and about high-tech business models? (Notice how the big IPOs lately all have pretty clear revenue streams from advertising.) How could one know in advance that Pets.com would not be Amazon.com, or vice-versa? How does a VC know which of his investments will go bankrupt and which will own an industry? Tell me: if tomorrow a break is discovered in the core Bitcoin protocol/cryptography and the price goes to $0.00, was Bitcoin a bubble or a mistake?


To summarize: I think you are grasping at surface features, not thinking about the anti-bubble arguments or are just unfamiliar, and are engaged in post hoc analysis where you select out of the buzzing hive of argument and disagreement a few strands which seem right to you with the benefit of many years of data.

Comment author: mwengler 23 October 2013 01:41:39PM 0 points [-]

OK you like EMH so much that you think 9 students from one professor all outperforming for decades is cherry picking and data mining. I think it is finding a small group of people wh oclaim to be learning from someone who has empirically verified methods, and who, when they apply these methods, get the predicted results consistently for decades. I think characterizing this as cherry picking and data mining is at more likely to be a bad explanation for what is being seen than is mine, which is that they are doing what ehy say they are doing, and it is working.

Even a broad index fund is "managed." The conditions for being listed are quite stringent, and involve "survival bias" filters, if stocks fall below a certain value they are delisted. I actually don't think that the difficulty of beating the SP500 is much of a proof of EMH as much as it is a proof that very straigtforward standards applied on a slow timescale capture almost all of the value available from managing a portfolio. I think people investing more broadly than SP500, people investing with people who come in to their living rooms seeking "angel" investors do a lot worse. If the market was efficient in principle, then one wouldn't need the SP500 or even the NASDAQ seal of approval to wind up with results that were at the market mean. If usnig your brain is required to pick SP500 over living room pitch man, then in principle, using your brain is required to get reasonable results.

I think if a proposition of efficiency is to be proved true, ti si not by looking at the average performance of every tom dick and harry and noticing that with mathematical necessity they tend to have the same mean as the market which of course they comprise. I think a proper proof of efficinecy requires showing in detail that there are no consistent outliers of high performance. That funds with decades long records of outperformance occur at the proper rate to be consistent with pure luck. Indeed, to show that while it appears that some people predictably outperform, that for all these actors past performance is no predictor of future performance, and that the hangers on that joined Buffett in the 60s or 70s or 80s or 90s after seeing his record THOUGHT their outperformance was due to their identifying a winner, but that it was consistent with just pure dumb continuous luck.

I think their is a gigantic difference between "we cannot prove that their is alpha" and "the most likely explanation of what we see is that their is no alpha."

As to identifying bubbles that were not bubbles, the only bubbles I have identified are tech,and real estate. I identified a "bubble" in a small company stock (Conductus) where a company with no real products generated excitement by talking about how they were getting in to the cellular industry, driving their stock price from 3 to about 80 before they crashed back down to 3. I shorted them at about 70, took my returns a few weeks later at 60 or so, they proceeded to rise to 80 and then within a year drop back to 2.5. I identified another mispricing in NHCS where numerically they were spinning out a company which was being completely undervalued in their current stock price. I asked others "can this really be true," they said only in general yeah stuff like that happens. I bought a few thousand dollars worth, made the 20% or so return it seemed I was seeing laying on the table a few months later.

The main sense in which the market seems efficient is that the prices are predominantly set using sensible analyses, presumably because those who do not follow a proven technique of picking sensible prices do not survive, so the main component of market efficiency is that the processes for beating the market are broadly exercised and dominating the market. So it is hard to do better than free-riding on that. But does it turn out that some people do better at that process than others? I think the best explanation for what we see is that yes, some do, and that they are a smallish minority is not because they are just the tail of a random distribution, but because of mathematical necessity beating the average significantly can only be done by a minority.

Anyway, thanks for sticking with it and explaining your position to me.

Comment author: gwern 23 October 2013 06:41:36PM 1 point [-]

OK you like EMH so much that you think 9 students from one professor all outperforming for decades is cherry picking and data mining.

To expand even further on my critique: you are placing a huge amount of weight on 9 students, of unknown veracity, out of an unknown number of students (itself out of an unknown number of millions of people who have tried to beat the market over the past century), who have not released audited records much less ones comparing them to indexing, who started half a century ago (which is the investing dark ages compared to what goes on now, in 2013), and at least one of whose successes seem to be partially explained by non-efficiency-related factors?

This is roughly as convincing as Acts of the Apostles documenting the 12 apostles' successes in beating the (religious) market and earning converts.

I think people investing more broadly than SP500, people investing with people who come in to their living rooms seeking "angel" investors do a lot worse. If the market was efficient in principle, then one wouldn't need the SP500 or even the NASDAQ seal of approval to wind up with results that were at the market mean.

Those angel investors are forfeiting diversification and so can easily earn below-average returns. EMH doesn't mean that you cannot deliberately contrive to lose money.

I think their is a gigantic difference between "we cannot prove that their is alpha" and "the most likely explanation of what we see is that their is no alpha."

I think in an adversarial environment where everyone claims to be able to beat the market and you should give them their money, and there are compelling theoretical reasons that any beating of the market would wipe out whatever advantage was posssed, there is not such a gigantic difference.

I bought a few thousand dollars worth, made the 20% or so return it seemed I was seeing laying on the table a few months later.

Congratulations on your day-trading success. You know what happens to most of them, right?

Comment author: Lumifer 23 October 2013 06:47:48PM 1 point [-]

EMH doesn't mean that you cannot deliberately contrive to lose money.

Under EMH is pretty hard to deliberately and consistently lose money. It's very easy to get additional risk (e.g. by not diversifying), but I don't think EMH envisions assets with negative expected return.

Comment author: gwern 23 October 2013 10:52:29PM 3 points [-]

Mm, the way I remembered was that by not diversifying, you were taking on additional uncompensated risk; not diversifying wasn't completely neutral, expected-value wise. (Also, there's obvious ways to guarantee losing money: trade a lot. The fees will kill you.)

Comment author: mwengler 26 October 2013 06:53:01PM 0 points [-]

... who have not released audited records much less ones comparing them to indexing, ...,

Actually the records ARE audited, they ARE compared to indexing, and those records and comparisons are reported by the original article I mentioned, which I finally link to here.

you are placing a huge amount of weight on 9 students

If a professor's students dominate some part of engineering or biology or chemistry, it is generally taken as evidence that the professor was teaching something real. I suppose if we had an Efficient Knowledge Theory we would understand that going to Caltech or MIT was as wasteful as picking up $20 bills on the sidewalk (which don't exist in a classic EMH joke).

Should we be questioning whether a good education in philosophy or math or physics or engineering or biology or... is just a mismatch between the power of random chance and the human bias towards seeing patterns? Or is there something special about learning how to value companies that puts it in a category of analysis that is different from all other observations of the effects of knowledge?

In any case, the article linked discusses the randomness hypothesis extensively pointing out among other things that the various investors reported upon had exceedingly small amounts of overlap in what they actually invested in.

Gwern, these comments are not so much aimed at you, you have obviously been down these roads and decided which way you would turn. They are aimed at anybody reading this who is still not sure about EMH. The article linked is excellent and written by a guy who walks the walk better than anybody else in human history (so far).

Comment author: gwern 26 October 2013 11:22:32PM *  1 point [-]

Actually the records ARE audited, they ARE compared to indexing, and those records and comparisons are reported by the original article I mentioned

I don't see any mention of how they were audited (Buffett merely says that they 'were audited', no mention of by whom, when, what the audits said, whether he saw the results, etc, and offers as reassurance that checks were paid for the appropriate amounts, which is not my problem here), and if you really want to nitpick, then I would bring up that Buffet does not talk about '9' students, he actually talks about 4 people who worked for Graham, tells us that 'it's possible to trace the record of three' (well, there's some selection bias right there...) and does not explain how the 3 partners did (more selection bias), and some of his other examples are questionable at best - including his very good friend Munger, including two funds he 'influenced' (while disclaiming that he might have influenced any other funds and this isn't cherrypicking, which I don't understand how he can honestly say how he knows for sure he has not similarly influenced any others), reporting different metrics for different examples (why is Munger compared against the Dow while others are compared against the S&P?), not comparing against an index (table 8), and some do not beat the comparison index at all (Table 9, Becker, underperforms S&P by 3%)

If a professor's students dominate some part of engineering or biology or chemistry, it is generally taken as evidence that the professor was teaching something real.

Buffett doesn't dominate the markets, and the proper comparion is to ideas, not students - if a single professor's students dominated, I'd be more inclined to suspect corruption or logrolling or the professor being a genius at academic infighting and bureaucracy...

I suppose if we had an Efficient Knowledge Theory we would understand that going to Caltech or MIT was as wasteful as picking up $20 bills on the sidewalk...Should we be questioning whether a good education in philosophy or math or physics or engineering or biology or... is just a mismatch between the power of random chance and the human bias towards seeing patterns?

Markets are very different from electronic circuits or particle physics or philosophy or engineering. Circuits don't care if you found a more efficient way to design them. The properties of steel will not change when you discover it lets you build profitable bridges.

Or is there something special about learning how to value companies that puts it in a category of analysis that is different from all other observations of the effects of knowledge?

Er, yes, there is. That's kind of the point of the efficient markets concept! Markets are unusual and special in that the attempt to find predictable regularities leads to the exploitation of the regularities and their disappearance. (Eliezer describes this as "markets are anti-inductive", which is not wrong, but I'm convinced there must be some more intuitively understandable phrase than that.)

Gwern, these comments are not so much aimed at you, you have obviously been down these roads and decided which way you would turn. They are aimed at anybody reading this who is still not sure about EMH.

Is that one article really the best, solidest, most convincing criticism of EMH you can come up with, which you think will persuade people reading this conversation that EMH is to a meaningful degree false and markets are often beatable - some cherrypicked questionable examples from the dawn of time?

Comment author: mwengler 22 October 2013 06:09:21PM 0 points [-]

I'd rather use a more powerful EMH-focused definition: a bubble is large price increase which represents an inefficiency in the market which is predictable in advance (not in hindsight), exploitable, and worth exploiting.

I'm happy with that definition. EMH (Efficient Market Hypothesis) for those of you following along at home.

In my case I had amassed a small fortune by October of 1999 by simply holding the stock options I had been granted on taking the job 4 years earlier. They were up more than 10X at that point. Actionable? My very intelligent college roommate owned his own financial advising firm. He spent two weeks on the phone with me convincing me that it would be gigantically more sensible to cash out these options and give them to him to invest "in case, in the future, people get up in the morning, put their clothes on, and go outside instead of sitting in front of their PCs all day ordering stuff off the internet." He sent me books to read including this one first published in 1841. This describes witch hunts as well as South Sea, Tulip and other financial bubbles. Jim, my roommate, had been referring to tech as a bubble for a year or two before I talked to him in October of 1999. The action he was taking with his other clients was to simply not get in to tech. This was a horribly unsatisfying strategy until about the middle of 2000 when tech was well into its slide from the top.

By the time I cashed out and handed him the money in about december 1999, the stock had more than doubled again. The human in me wanted to hold on to it because, obviously, this was a stock which kept on doubling. He explained to the rationalist in me that whatever the case for investing that money in something else was at half the price, the case was TWICE as good at twice the price, unless we had learned something quite important and positive about the business in the last two months. Which we hadn't of course. What we had learned is that there was no shortage of "greater fools" willing to buy in AFTER all that price appreciation had already happened on old information that was not changing nearly as fast as the price.

Over the next three years the stock I had sold in December 1999 gave back about 75% of its price gains. Meanwhile, my friend invested my money in REITs, Berkshire Hathaway, banks, and a bunch of other asset classes not even dreamed about by most of my fellow techies. The money I had given him grew by 40% more or less, I don't remember exactly, while the nearly half of my original stock grant I had kept in my employers stock contracted to 20% of its peak value.

So yes, to me the internet bubble appears to have been actionable before it burst. The "investors" who stayed with the bubble, myself included with what started out as nearly half of my fortune and ended as about a tenth of it. The shift of 60% of my money out of the bubble preserved my wealth at a level that may well have been unique among my peers at this company.

I realize you can't get a drug approved with this kind of evidence. But you realize that most of what we "know" is the best model we can come up with in the absence of double blind studies. I've detailed the one best example in my life. I agree it is HARD to act on bubbles, shorting them is scary and fraught with risk, you are betting you can stay solvent longer than the market can stay stupid, which is quite a bet indeed. So bubbles, so spectacularly obvious in retrospect, may be no more reliably useful for making money than is any mispricing, even smaller more temporary ones.

Out of curiousity, are you enough of an EMH'er that you don't believe in mispricings? Or at least not in publicly traded financial securities markets? Do you think it is just a roll of the dice that 9 students of Ben Graham all ran funds which had long term returns above market averages? I think a bubble is just a particular kind of mispricing, a particular kind of inefficiency. It may be no easier to exploit than the other kinds of mispricings, but it is probably not harder to exploit. And shorting is not the only way to exploit bubbles or mispricings, just sticking with a discipline which on average avoids them appears to work for a broad range of investors, including such low-entropy categories of investors as former students of one professor who espoused value investing.

Comment author: gwern 22 October 2013 08:51:14PM *  0 points [-]

Actionable? My very intelligent college roommate owned his own financial advising firm. He spent two weeks on the phone with me convincing me that it would be gigantically more sensible to cash out these options and give them to him to invest "in case, in the future, people get up in the morning, put their clothes on, and go outside instead of sitting in front of their PCs all day ordering stuff off the internet."

This actionable advice is also 100% justifiable without recourse to claims of superior perception simply by the high value of diversification. Keeping a large sum of money in a single stock's options is really risky, even if you think it's +EV, and even if you think some EMH conditions don't apply (you had insider knowledge the market didn't, the market was not deep or liquid, you had special circumstances, etc). Same reason I keep telling kiba to cash out some of his bitcoins and diversify - I am bullish on Bitcoin, but he should not keep so much of his net worth in a single volatile & risky asset.

He sent me books to read including this one first published in 1841.

MacKay is not the most reliable authority on these matters, you know. The book I mention punctures a few of the myths MacKay peddles.

Jim, my roommate, had been referring to tech as a bubble for a year or two before I talked to him in October of 1999. The action he was taking with his other clients was to simply not get in to tech. This was a horribly unsatisfying strategy until about the middle of 2000 when tech was well into its slide from the top.

An anecdote, as you well realize. You recall the hits and forget the misses. How many other bubbles did Jim call over the years? Did his clients on net outperform indices?

Meanwhile, my friend invested my money in REITs, Berkshire Hathaway, banks, and a bunch of other asset classes not even dreamed about by most of my fellow techies. The money I had given him grew by 40% more or less, I don't remember exactly

And would have grown by how much if they had been in REITs in 2008?

I agree it is HARD to act on bubbles, shorting them is scary and fraught with risk, you are betting you can stay solvent longer than the market can stay stupid, which is quite a bet indeed.

It's not just that you're betting that you can stay solvent longer, you're betting that you have correctly spotted a bubble. There was a guy on the Bitcoin forums who entered into a short contract targeting Bitcoin at $30. Last I heard, he was upside-down by $100k and it was assumed he would not be paying out.

Do you think it is just a roll of the dice that 9 students of Ben Graham all ran funds which had long term returns above market averages?

As a matter of fact, someone a while ago emailed me that to try to argue that EMH was false. This is what I said to them:

A cute story from long ago, but methinks the lady doth protest too much - he may say he has not cherrypicked them, but that's not true: the insidious thing about datamining and multiple comparison is that there's nothing false about the results, if you slice the data such-and-such a way you will get their claimed result. And even if there are no other employees or contractors or students quietly omitted and we take everything at face value, he hasn't shown that they aren't counted in the coin-flipping orangutans given a loaded coin producing 7% returns a year. Why aren't his former coworkers giving away dozens of billions of dollars? If they were beating 7% like he says they were, they should - in 2012, 28 years later - be sitting on immense fortunes. Buffett himself seems, these days, to generate a lot of Berkshire profit just from being so big and liquid, in selling all sorts of insurance and making huge purchases like his recent railway purchase.

I don't think that even begins to overturn efficient markets, sorry.

Speaking of Buffett's magical returns, I found http://www.prospectmagazine.co.uk/economics/secrets-of-warren-buffett/ interesting although I'm not competent to evaluate the research claims.

Out of curiousity, are you enough of an EMH'er that you don't believe in mispricings? Or at least not in publicly traded financial securities markets?

Pretty much. I believe in inefficiencies in small or niche markets like Bitcoin or prediction markets, but in big bonds or stocks? No way.

It may be no easier to exploit than the other kinds of mispricings, but it is probably not harder to exploit.

I have watched countless people, from Paulson to Spitznagel to Dr Doom to Thiel, lose billions or sell their companies or get out of finance due to failed bets they made on 'obvious' predictions like hyperinflation and 'bubbles' in US Treasuries since that housing bubble which they supposedly called based on their superior rationality & investing skills. It certainly seems like it's harder to exploit. As I said, when you look at complete track records and not isolated examples - do they look like luck & selection effects, or skill & sustained inefficiencies?

Comment author: mwengler 29 October 2013 07:59:47PM 0 points [-]

Speaking of Buffett's magical returns, I found http://www.prospectmagazine.co.uk/economics/secrets-of-warren-buffett/ interesting although I'm not competent to evaluate the research claims.

I heartily endorse this analysis. I would recommend actually the original paper rather than the review of that paper cited by gwern.

At no point that I could find in this paper did they find that they needed to appeal to luck or random outlier quality to explain Buffett's performance. Indeed, except that it is decades after the fact, it seemed fairly simple for them to explain Buffett's performance quantitatively from picking stocks that the author's say systematically outperform the market, sticking with his method of picking stocks in good and bad times for his portfolio or the market as a whole, and in using a moderate amount of leverage, they estimate about 1.6.

Not rocket science, not snake oil, and not a long sequence of lucky coin-flips.

Comment author: satt 26 October 2013 04:31:05PM *  1 point [-]

How well did it handle tech stocks in 1999?

How high are the stock prices of Amazon, Google, and Apple now?

Bit of a glib response. (One could ask, equally rhetorically, "How high are the stock prices of Tiscali, lastminute.com, and InfoSpace/Blucora now?") But since you elaborated below with actual arguments I won't press this point.

Tulip bulbs back in the day?

Everything you know about Tulipomania is false or incomplete. I suggest reading Famous First Bubbles.

Does the book go beyond Garber's papers on tulipmania? My reading of Garber's argument in those papers is:

  1. Most people get their ideas about the tulip market from Charles Mackay, but he plagiarized his account, and it ultimately comes from "three anonymously written pamphlets".

  2. Mackay exaggerated, among other things, the amount of national-level economic distress resulting from the tulip mania.

  3. "Mackay did not report transaction prices for the rare bulbs immediately after the collapse", which are the prices one would need to establish the popping of a bubble. Instead he quoted high prices from before the bubble popped, and prices "from 60 or 200 years after the collapse". But what he found could be consistent with the prices accurately reflecting changes in fundamentals. Why? Because a new & attractive variety of flower might gradually come into fashion (raising its price) and then suffer a glut over time as more bulbs become available (lowering its price).

  4. One can confirm that's how things normally worked by looking at changes over time in prices long after the bubble. Even in non-bubble times, bulb prices would consistently start high and then fall steadily.

I don't disagree with those claims, as far as they go, but highlighting a lack of conclusive evidence for a bubble doesn't mean there wasn't a bubble. Even Garber's seemingly damning review of the price data doesn't mean much, because Garber (like Mackay) fails to quote prices from immediately after the collapse.

What Garber actually does is calculate that tulip bulb prices depreciated by 24%-76% per year over the 5-6 years after the peak. He compares that to the 2%-40% annual depreciation of bulb prices in the next century, says the earlier rates are only modestly higher than the later rates, and so there wasn't a bubble-indicating deviation from normal depreciation.

But Garber would likely have seen the same thing even if there had been an abrupt bubble pop. Suppose a tulip bulb's price peaked at 1000 guilders, crashed to 200 guilders within a week, then sank gradually to 100 guilders over the next five years. An economist who, knowing only the start & end points, interpolated to estimate the annual depreciation would (if I've done the sums right) get a 37% rate, which gives no sign of the initial crash. Observing a normal depreciation rate isn't good evidence against a bubble; one has to know prices closer to the event.

Does Garber's book have those data, or at least a novel argument missing from his papers?

Comment author: gwern 26 October 2013 05:35:09PM 0 points [-]

Bit of a glib response.

Yes, but it hopefully wakes up people who glibly point at one stock or one price change as proof positive of bubbles: the claim for bubbles is a long-term statistical claim, and cannot be supported by simply going "Tulips!"

Does the book go beyond Garber's papers on tulipmania?

I don't know. Not really interested in taking the time to compare them in detail. Presumably the book form includes much more detail than space-restricted papers.

I don't disagree with those claims, as far as they go, but highlighting a lack of conclusive evidence for a bubble doesn't mean there wasn't a bubble.

Given how many people cite Tulipomania as a irrefutable smackdown in these sorts of discussions ('Bitcoins are worthless - at least you could plant tulips!'), learning that there is minimal evidence for what is popularly considered to be a large, irrefutable, historically established, unquestionable bubble should badly damage one's confidence in other claims relating to bubbles since it tells one a lot about what passes for evidence in those discussions.

Observing a normal depreciation rate isn't good evidence against a bubble; one has to know prices closer to the event.

It's been a while since I read the book, but doesn't he do exactly that and does compare depreciation from peak prices in places? For example, on pg64 of my copy:

Even from the peaks of February 1637, the price declines of the rarer bulbs, English Admiral, Admiral van der Eyck, and General Rotgans, over the course of six years was not unusually rapid. We shall see below that they fit the pattern of decline typical of a prized variety...Prices for these bulbs declined at an average annual percentage rate of 28.5 percent. From table 9.1, the three costly bulbs of February 1637 (English Admiral, Admirael van der Eyck, and General Rotgans) had an average annual price decline of 32 percent from the peak of the speculation through 1642. Using the eighteenth-century price depreciation rate as a benchmark also followed by expensive bulbs after the mania, we can infer that any price collapse for rare bulbs in February 1637 could not have exceeded 16 percent of peak prices. Thus, the crash of February 1637 for rare bulbs was not of extraordinary magnitude and did not greatly affect the normal time series pattern of rare bulb prices.

Comment author: satt 28 October 2013 12:17:24AM 2 points [-]

Presumably the book form includes much more detail than space-restricted papers.

I'd hope so, although I can imagine an academic padding things out with irrelevant side detail or other yakkety-yak-yak. In those cases one may as well stick with the papers.

Observing a normal depreciation rate isn't good evidence against a bubble; one has to know prices closer to the event.

It's been a while since I read the book, but doesn't he do exactly that and does compare depreciation from peak prices in places? For example, on pg64 of my copy:

Not based on that quote. That's the same reasoning he uses in his papers. (Your quoted bit appears, almost word-for-word, on pages 550 & 553 of the "Tulipmania" paper.) The flaw is the same; estimating a depreciation rate based on data points 5-6 years apart won't tell you whether there was an abrupt dip that took only a few days or weeks.

learning that there is minimal evidence for what is popularly considered to be a large, irrefutable, historically established, unquestionable bubble should badly damage one's confidence in other claims relating to bubbles since it tells one a lot about what passes for evidence in those discussions.

It is a good example of why one shouldn't take people's claims that something's a bubble at face value. Although I don't think the magnitude of the tulipmania has much bearing on whether tech stocks, Bitcoins, or real estate are/were bubbling; for those last three things, there are time series data that're a lot more relevant than what happened to Dutch tulip bulbs 376 years ago.

(I also wonder whether I updated too much on the basis of one economist's contrarianism. Really, I went too far in my last comment by referring to "a lack of conclusive evidence for a bubble" — it's not as if I've looked for that evidence. I've just taken Garber's word for it.)

Comment author: gwern 28 October 2013 02:35:18AM 1 point [-]

The flaw is the same; estimating a depreciation rate based on data points 5-6 years apart won't tell you whether there was an abrupt dip that took only a few days or weeks.

But comparing peak prices to prices years later does tell you that any 'abrupt dip' must have been compensated for by other price increases or maintenance of prices. If prices, from the peak, abruptly go down and then abruptly go up, and then follow their usual depreciation curve, that's not a very bubbly story.

Although I don't think the magnitude of the tulipmania has much bearing on whether tech stocks, Bitcoins, or real estate are/were bubbling; for those last three things, there are time series data that're a lot more relevant than what happened to Dutch tulip bulbs 376 years ago.

Sure. It drives me nuts how people constantly bring up Tulipomania. Whether or not one agrees with Garber's findings, it should still be obvious to them that arguing about modern finance based on Tulipomania is like trying to criticize American government based on ancient Greek politics - the sources are bad and don't answer the questions we want to know, and even if we did have perfect knowledge of what happened so long ago, the circumstances were so different and the world was so different that it can tell us very little about vaguely similar modern situations.

I also wonder whether I updated too much on the basis of one economist's contrarianism.

Maybe! I wonder that sometimes myself. But honestly, Tulipomania has the feel of one of those parables which are too good to be true, so I don't expect a later economist to come along and say 'everything you thought you knew from Garber is false! yes, the stuff about tulip-breaking virus is false! and tulip bulbs don't depreciate extremely fast! the futures contracts weren't canceled! there were no extenuating circumstances like plague!' etc

Comment author: satt 28 October 2013 02:56:07AM 0 points [-]

But comparing peak prices to prices years later does tell you that any 'abrupt dip' must have been compensated for by other price increases or maintenance of prices.

I don't follow. Garber's data are consistent with the scenario I sketched in the penultimate paragraph of this comment, where I assume away any compensation for the initial dip.

If prices, from the peak, abruptly go down and then abruptly go up, and then follow their usual depreciation curve, that's not a very bubbly story.

Yeah, Garber's data are also consistent with an initial rebound.

Sure. It drives me nuts how people constantly bring up Tulipomania.

Fair enough.

I don't expect a later economist to come along and say 'everything you thought you knew from Garber is false! yes, the stuff about tulip-breaking virus is false! and tulip bulbs don't depreciate extremely fast! the futures contracts weren't canceled! there were no extenuating circumstances like plague!'

Plague? Now that's something I don't think he mentions in the papers. (Must...resist...urge to borrow...yet another...book.)

Comment author: gwern 28 October 2013 03:06:02AM 0 points [-]

where I assume away any compensation for the initial dip...Garber's data are also consistent with an initial rebound.

No, you don't. You bury it in the 'sank gradually' part:

But Garber would likely have seen the same thing even if there had been an abrupt bubble pop. Suppose a tulip bulb's price peaked at 1000 guilders, crashed to 200 guilders within a week, then sank gradually to 100 guilders over the next five years.

You can get an abrupt pop inside an normal-looking beginning/end comparison if something compensates for the pop, like another rise (unlikely) or prices then falling slower than they normally would ('gradually'). The ground lost in the pop is then made up later.

Plague? Now that's something I don't think he mentions in the papers.

His book's capsule summary of that bit goes

The speculation in common bulbs was a phenomenon lasting one month in the dreary Dutch winter of 1637. A drinking phenomenon held in the taverns, it occurred in the midst of a massive outbreak of bubonic plague and had no real consequence.

It's the topic of chapter 5, "The Bubonic Plague".

(Must...resist...urge to borrow...yet another...book.)

(It's on Libgen, and isn't a very long book.)