All of Pablo's Comments + Replies

Pablo106

I think there is a vast difference between Gerard and Kruel, not just in the damage each has caused but also in their intellectual honesty and responsiveness to argument (null in the case of Gerard, decent in the case of Kruel, at least from my recollection).

Pablo*170

One of the biggest online threats to rational discourse, “RationalWiki”, just reached a settlement with all but one of the eight plaintiffs suing them, and deleted the corresponding biographical entries. They are also considering pre-emptively removing all their other hit pieces—countless articles that have ruined careers, stifled research, and brought entire fields of inquiry into undeserved disrepute.

habryka220

I think I am, all things considered, sad about this. I think libel suits are really bad tools for limiting speech, and I declined being involved with them when some of the plaintiffs offered me to be involved on behalf of LW and Lightcone. 

I do think RationalWiki is one of the better applications of the relevant law, but the law is too abuse-prone, and normalizing its use would cause much more harm than RationalWiki ever caused, that I don't think this was the right choice by the plaintiffs. I think it would have been a big personal sacrifice for the ... (read more)

8ROM
I think calling them "one of the biggest online threats to rational discourse" seems like a wild overstatement. That said, I was surprised to learn that RatWiki had a much higher reach compared to LW until very recently (when going by google trends). 
2Dagon
If this is true, I'm relieved, because it means there are no serious threats.  But I doubt it..  I hadn't heard the name for a number of years, and even in the heyday it only mattered in a tiny part of a tiny sub-community.
Pablo20

I agree this looks promising and is the reason I bought long-dated SPY calls a few weeks ago (already up by 30%). But I would feel more reassured if I felt I could understand why such an opportunity persists. What is the mental state of the person on the other end of this trade?

3DPiepgrass
I've seen a lot of finance videos talking about the stock market and macroeconomics/future trends that never once mention AI/AGI. And many who do talk about AI think it's just a bubble and/or that AI ≅ LLMs/DALL·E; prices seem high for such a person. And as Francois Chollet noted, "LLMs have sucked the oxygen out of the room" which I think could possibly slow down progress toward AGI enough that a traditional Gartner hype cycle plays out, leading to temporarily cooler investment/prices... hope so, fingers crossed.
4CMinge
I assume the person on the other side of the trade thinks a reasonable probability distribution for the S&P 500 tail events is roughly what the distribution in fact was for S&P 500 tail events in the last century (with some minor-moderate adjustments for changes to the economy). The current market price for 12k-2028 implies a chance of profit of 1.81%, which is around how often, in Sapphire's analysis, that the S&P 500 doubled in 4 years, 4.3% (which is the scenario where the 12k-2028 calls would be in the money by expiration).    Less precisely, the other person basically expects that the options they're selling will most likely go to 0, since similar options have almost always gone to 0 historically. So writing more contracts gets them money in exchange for a slim chance they would need to sell other assets to cover a loss.
Pablo20

Can you share the spreadsheet/code on which the calculations are based?

3sapphire
Done. 
Pablo41

Yeah, that makes sense, especially if combined with the feature that allows users to disagree with specific parts of the post, as Michael notes. (Though note that the disagree vote is anonymous, whereas disagreeing with a selection is public, so the two aren’t fully comparable.)

Pablo40

This is currently at –1 despite being a carefully reasoned post on an important topic. I wonder if the downvoter(s) would have used the disagree vote instead had it been available. (More generally, it is unclear why that button is available in comments but not in posts.)

1MichaelStJules
FWIW, users can at least highlight text in a post to disagree with.
3Richard_Kennaway
The moderators have said that it is because posts tend to cover a range of stuff, rendering a block-vote agree or disagree less useful. Comments, on the other hand, tend to be narrower, making agree/disagree more useful. Moderators are invited to agree/disagree on the narrow topic of my characterisation of their reasoning. :)
Pablo20

I'm still thinking about how to hedge incase the upcoming chaos turns the market sour

Have you thought more about this? How about VIX call options?

Pablo30

Thanks—I understand now. I thought $855 was the price SPY would reach if the current price increased by 50%. 

Pablo20

If you buy a $855 Strike price call for that date and SPY increases 50% by then you get a 12x return.

I never traded options, but isn’t the return you get critically sensitive on the date before expiration by which the strike price is hit? If this happens just before expiration, my understanding is that the option is worthless: there is no value in exercising an option to buy now at some price if that happens to be the market price. More generally, it makes a big difference whether the strike price is hit one week, one month, or one year before expiration.

Are you making any implicit assumptions in this regard? It would be useful if you could make your calculations explicit.

3jow
The option to buy SPY at $855 in January 2027 is going for $1.80 today, because most people don’t expect the price to get that high. But if in fact SPY increases in the intervening time by 50% from its present value ($582), as stipulated by kairos, then the option will ultimately be worth 1.5*582 - 855 ~ $18. I think this is where the 12x figure is coming from.
Pablo42

Mmh, if there is no reason to take that particular trader seriously, but just the mere fact that his trades were salient, I don’t see why one should experience any sense of failure whatsoever for not having paid more attention to him at the time.

Still, my main point was about the reasons for taking that particular trader seriously, not the sense of failure for not having done so, and it seems like there is no substantive disagreement there.

Pablo20

Why do you focus on this particular guy? Tens of thousands of traders were cumulatively betting billions of dollars in this market. All of these traders faced the same incentives.

Note that it is not enough to assume that willingness to bet more money makes a trader worth paying more attention to. You need the stronger assumption that willingness to bet n times more than each of n traders makes the single trader worth paying more attention to than all the other traders combined. I haven’t thought much about this, but the assumption seems false to me. 

7Zac Hatfield-Dodds
Because I saw a few posts discussing his trades, vs none for anyone else's, which in turn is presumably because he moved the market by ten percentage points or so. I'm not arguing that this "should" make him so salient, but given that he was salient I stand by my sense of failure.
Pablo50

Audible has just released an audio version of Nick Bostrom’s Deep Utopia.

I was delighted to learn that the audiobook is narrated by David Timson, the English actor whose narrations of The Life of Samuel Johnson and The Decline and Fall of the Roman Empire I had enjoyed so much. I wonder if this was pure chance or a deliberate decision by Bostrom (or his team).

Pablo42

pollsters will have attempted to correct mistakes, and if they knew that there would be an R/D bias this time, they'd adjust in the opposite way, hence the error must be unpredictable.

Exactly. Silver has discussed this dynamic in some of his old FiveThirtyEight articles. The key is to appreciate that polling error is not an effect one can naively predict by looking at past data, because it is mediated by polling agencies’ attempts to correct it.

Pablo*508

Silver’s model and most other lines of evidence indicate that the US presidential race is as close to a tossup as it gets. But, as of this writing, you can buy Harris contracts on Polymarket for 38 cents. The explanation for this apparent mispricing seems to be that, over the past few days, a single pro-Trump trader has poured tens of millions of dollars into the platform. “Domer”, the author of the linked tweet and Polymarket’s most successful trader to date, claims that this effect has depressed Harris’s contract price by around five cents, though I am u... (read more)

Strong upvote because I literally wanted to write a quick take saying the same thing and then forgot (and since then the price has moved down even more).

I don't think the inefficiency is as large as in 2020, but like, I still think the overall theme is the same -- the theme being that the vibes are on the R side. The polling errors in 2016 and 2020 just seemed to have traumatized everyone. So basically if you don't think the vibes are tracking something real -- or in other words, if you think the polling error in 2024 remains unpredictable / the underlying distribution is unbiased -- then the market is mispriced and there's a genuine exploit.

Pablo30

There is an archived version here.

Pablo20

What are, in you assessment, some of the most cost-effective ways of throwing money at the problem of reducing existential risk?

8Wei Dai
Can't claim to have put much thought into this topic, but here are my guesses of what the most cost-effective ways of throwing money at the problem of reducing existential risk might include: 1. Research into human intelligence enhancement, e.g., tech related to embryo selection. 2. Research into how to design/implement an international AI pause treaty, perhaps x-risk governance in general. 3. Try to identify more philosophical talent across the world and pay them to make philosophical progress, especially in metaphilosophy. (I'm putting some of my own money into this.) 4. Research into public understanding of x-risks, what people's default risk tolerances are, what arguments can or can't they understand, etc. 5. Strategy think tanks that try to keep a big picture view of everything, propose new ideas or changes to what people/orgs should do, discuss these ideas with the relevant people, etc.
Pablo40

This was an interesting read, which I only discovered because the post was highlighted on the front page. I took some quick notes, which I share below in case they are useful to anyone.


  • Rescuing Jews during the Holocaust wasn’t an especially effective “intervention”, compared to the internal politics of each Nazi-controlled country where Jews lived.
  • Moreover, rescuers didn’t appear to have many common traits, so creating would-be rescuers to prevent future genocides is not very tractable.
  • One trait that appears to have been shared by rescuers is that they “we
... (read more)
Pablo*53

If the strategy failed in predictable ways, shouldn't we expect to find "pre-registered" predictions that it would fail?

habryka176

I have indeed been publicly advocating against the inside game strategy at labs for many years (going all the way back to 2018), predicting it would fail due to incentive issues and have large negative externalities due to conflict of interest issues. I could dig up my comments, but I am confident almost anyone who I've interfaced with at the labs, or who I've talked to about any adjacent topic in leadership would be happy to confirm.

Pablo212

“How many Oxford dons does it take to change a lightbulb?”

CHANGE‽‽‽

Answer by Pablo42

To my knowledge, there is currently no method that will generate a reasonably exhaustive list of all the languages a given book has been translated into. I use a combination of Worldcat, Wikipedia, Amazon and Google.

Pablo40

Greg Lewis discusses this at length here.

Pablo*60

Metaculus generates lots of valuable metrics besides the "meaningless internet points" about which Zvi and others complained. If Yudkowsky had predicted regularly, he would have been able to know e.g. how well-calibrated he is, how his Brier score evolved over time, how it compares to the community's, etc.

Pablo50

There is no need to create a Flashcards tag when we already have Spaced repetition.

Pablo220

Keynes's view of Leninism seems similar to Russell's, and may have been influenced by it. Here's a quote from The Practice and Theory of Bolshevism (published in 1920):

Bolshevism is not merely a political doctrine; it is also a religion, with elaborate dogmas and inspired scriptures. When Lenin wishes to prove some proposition, he does so, if possible, by quoting texts from Marx and Engels. A full-fledged Communist is not merely a man who believes that land and capital should be held in common, and their produce distributed as nearly equally as possible. H

... (read more)
Pablo20

Thanks for the explanation.

Speaking personally, I would much prefer that contributions judged to make an article net worse be reverted than downvoted, both because this gives the contributor much clearer feedback and because it improves the quality of the article, relative to the opinion of the user deciding whether to downvote or revert. If other users disagree with that assessment, the karma system can perhaps then be used to resolve the disagreement, or to at least contribute to a resolution by conveying a signal whose meaning is now much easier to disc... (read more)

Pablo*40

I'm not sure how to interpret the downvoting of a recent edit I made. I simply clarified a sentence and replaced a dead link with the version archived by the Wayback Machine. Downvoting substantive posts without providing an explanation is often justified given the difficulty associated with pinpointing the nature of a complex disagreement, or because the signal the downvote is meant to convey is relatively clear from the context. But with a simple, atomic edit that seems unambiguously (very mildly) positive, at least from a commonsense perspective, such unexplained downvotes are apt to leave an editor puzzled and unable to draw any valuable lessons, except perhaps that they should simply abstain from contributing in the future.

2Vladimir_Nesov
The change feels to me like it made the page slightly worse. You added verbosity that's relevant to Overcoming Bias, but not to Robin Hanson, which dilutes the article (or just that sentence). This is way below the cutoff for what I would revert, so the downvote is a weaker signal than that. The voting volume on wiki edits is unfortunately too low, so any vote is likely to stay as it is, without reflecting a wider attitude of the readership. One use case where such downvoting becomes productive is if an edit gets significantly downvoted (which should sort it to the top, not hide it, I'm not sure how it's currently implemented), and that prompts someone to revert or re-edit. I was using the heuristic of only being careful with downvoting new users, which you are not, but it's a good point that wiki editing should be considered on its own, and there's currently almost no wiki editing going on, so one should err on the side of encouraging more activity. You also don't have many recent comments, maybe such things should also generally be taken into account, though it requires opening the user page to check. Some sort of "low recent activity, be welcoming" indicator in the mouseover popup on the usernames for those with less than N posts/comments in the last M months might help.
Pablo20

Related:

This week, I’ll spend 40–50 hours in Virtual Reality (Immersed), like I did last week and every (work) week for the last 2½ years. It’s not just fun and games — there are plenty of those, along with exercise, meditation, creativity, socializing, etc. — but for this article, I’m only focusing on (and counting) the work.
 

Yes, really: 8–10 hours a day strapped in. I’ve encountered a fair amount of skepticism about both the technology and the general premise, many nit-picks about the software, or how it fails to match some preconception about how things “should” work.

Pablo20

I decided to switch to Emacs 1.5 years ago, and I feel it's the most important computing decision I made since... starting to use a computer? I may write a more detailed post on what things I use Emacs for, but here I just wanted to endorse the above recommendation, including its caveats ("Don't bother with it though if you don't have some time to invest in learning it"), and emphasize that Emacs can fulfill many needs besides "code editor" (I am not a programmer myself).

Pablo*20

Thanks, but this post is no longer updated and the link is not broken on my website. (If you think that's confusing, despite the notice at the top, I may consider replacing its contents with just a link, though retaining the content may make it more discoverable.)

Pablo20

Thanks for the update!

chaotic History of Economic Analysis

The word 'chaotic' was an adjective I chose to describe the book's content, rather than part of the book's title. :)

1Yoav Ravid
whoops, fixed it :)
Pablo70

Related to the ReplicationMarkets example: on Metaculus, there is an entire category of self-resolving questions, where resolution is at least in part determined by how users predict the question will resolve. We have seen at least one instance of manipulation of such questions. And there is even a kind of meta-self-resolving question, asking users to predict what the sentiment of Metaculus users will be with regard to self-resolving questions.

2NunoSempere
Looks pretty fun!
Pablo90

The probability I would assign to #8 intuitively is about 0,41. Math based on my other three predictions yields (doing the calculation now) 0.476. I am going to predict the math output rather than my intuition.

I think the correct response to this realization is not to revise your final answer so as to make it consistent with the first three. It is to revise all four answers so that they are maximally intuitive, subject to the constraint that they be jointly consistent. Which answer comes last is just an artifact of the order of presentation, so it isn't a rational basis for privileging some answers over others.

4Adam Zerner
I think this question needs clarification. It's one thing to have a button that basically links to Ought (perhaps with some text explaining how it works; or perhaps Ought would have a specific landing page for LW that explains how it works). It's another thing for the the experience to be self-contained inside of LW, eg. where you wouldn't have to leave lesswrong.com and go to ought.com. I'd say 90% likelihood for the former since it is simple and I sense that the LW team would judge it to be worth it, but maybe 20% for the latter since a) it is complex, b) I sense that there are other high priority things they'd like to get to, and c) I worry that usage of this feature will fizzle out due to my reasoning in the parent comment, and with usage fizzling out I expect that it'd fall down the LW team's priority list.
8Bird Concept
Community once again seems too optimistic, prior is just very heavily that most possible features never ship.
Pablo20

The contracts are denominated in USD, and they pay in that currency. But you trade on margin, and the collateral can be in any currency (crypto or fiat). In your example, you get back the BTC plus 15% of what that BTC was worth in USD when you made the trade. 

Incidentally, TRUMPFEB is now trading at 0.16 (i.e. implied 16% chance that Trump is president next February). This looks insane to me (and I have bet accordingly). I'd be curious if you or others have further thoughts on what might be going on.

1knite
What were (or are now) the best places for US persons interested in betting significant crypto sums?
Pablo20

I'm not sure I understand your argument, given that FTX allows traders to keep balances in both USD and BTC, but in any case historically FTX prices have been in line with Betfair/PredictIt prices, so I doubt this consideration is relevant.

2Zvi
I haven't used FTX because illegal in USA slash usual worries. So you could deposit BTC, bet on the election, and if you win always get back your BTC+15%? Or not?
Pablo*60

I'm too lazy to look it up, but I did research this a couple of weeks ago and found that 538 had indeed outperformed the markets both in 2008 and 2016 (I wasn't able to find data for 2012). This is not very informative, though, since it's just a couple of cases. Much better is to look at the state-level predictions and use brier scores as a measure of forecasting performance.

9Alex K. Chen (parrot)
538 totally outperformed in 2012 on intrade - it seems like there were whales pushing up the romney price on intrade.
2FCCC
And this year too. I agree about the small sample size if we're just asking "Who will be president?" We should use every one of 538's predictions that could have been used to make a bet in a liquid betting market. If a profitable set of Kelly/Markowitz bets (under all election orderings) has a worse Brier score than the market's Brier score, I'd be more interested in the profit of the bets, since we're talking about betting money.
Pablo20

man do I wish that there was just one large market with minimal fees

Such a market exists, though unfortunately it is restricted to countries where most LW users are not citizens of.

Pablo*120

Only the first article in the comment is by Silver, on whose expertise the original poster is basing his recommendation. That article doesn't discuss mail-in ballots or voter suppression, and in fact his main point is that the time remaining until election day (almost three months when the article was written) combined with uncertainties due to Covid-19 meant that the race was still open back then. Those considerations have much more limited force at present, when only 16 days remain, and Biden's lead has widened considerably. 

If you've been at all li... (read more)

2Liam Donovan
This model seems reasonable, but I think bettors should mostly ignore the possibility of rejected mail in ballots, because the effect is extremely uncertain and around the same magnitude as many other idiosyncratic factors that should mostly wash out. For example, if there's severe weather or an outbreak of COVID on election day in a crucial swing state, that will hurt Trump much more than Biden because a much greater proportion of his voters are voting by mail (essentially the "rejected in person ballots" effect you mention). 
1Randomized, Controlled
The 538 distribution currently has Biden falling between... <squints> ~255 - 440 electoral votes 80% of the time (47% - 82%). Updating your guesstimate sheet with those ranges give a mean proportion to Trump of .38 with a range of .17 - 0.54
Pablo170

The book is dedicated "for Peter, who convinced me". Maybe that mysterious Peter is the ultimate cause of Christian's interest in Al alignment and his decision to write a book about it?

4riceissa
Seems like you were right, and the Peter in question is Peter Eckersley. I just saw in this post: That post did not link to a source, but I found this tweet where Brian Christian says:
Pablo20

Makes sense! Thanks for the explanation.

Pablo20

a frustratingly well-paywalled, yet exhaustive, complete and informative overview of the IARPA's FOCUS tournament

Since you quote from a section that is behind the paywall, I assume you have access to the article. If so, could you make it available? Or just send it to me (name@surname.com) and I'll upload it to my site and post a link to it here and on LW. Thanks!

7NunoSempere
I got sent it to me by the author of the article with the explicit request not to do that. I tried to check whether I could access it through any of my usual methods (disabling javascript, looking in the internet archive, using various extensions etc.), but realized I couldn't. I thought about not adding it to the newsletter at all, but realized that in this case, I actually respect their monetization model, and I liked the piece. In particular, this piece doesn't seem particularly clickbaity, a la SSC's Problems With Paywalls; instead it's a pretty good and lengthy feature article which took someone maybe a week (?) to write (the pdf version of the article is 16 pages). In contrast, other non-paywalled news media (I'm thinking of Forbes here) sometimes/usually cover forecasting questions so, so terribly. So that's my starting point. If you or other readers prefer not to see this kind of thing, I'm all ears.
Pablo40

Thanks for writing this—just a couple of days ago I thought it might be a good idea to get food pedals.

Since you use Karabiner, have you considered using goku to create "complex modifications"? It might help you make your keyboard more ergonomic and hence ease your wrist pain. I personally like to use the spacebar as a modifier key, and control the arrow keys with spacebar-j / k / l / i. You can also set spacebar-a / s / d / f to delete letter/word forward/backward. I actually have hundreds of modifications, but these are amongst the most ... (read more)

Answer by Pablo100

Acausalism.

Pablo20
Also it is good that you had here an example of something that a lot of people would view as a negative case (making the invention of the hydrogen bomb faster).

There's also the example of a work without which the Russian Revolution, and the subsequent deaths of tens of millions of people in famines and mass killings, may not have occurred. But until you mentioned it, I hadn't realized that fiction appears to be more often credited with having a positive than a negative influence, whereas for philosophy the reverse seems to be the case. Would be interesting to move beyond impressions and come up with a more rigorous way of testing this.

Answer by Pablo70

Some examples (I'm considering fiction generally and not just written fiction):

  • The film The Day After was seen by 100 million Americans and was instrumental in changing Reagan’s nuclear policy.
    • «President Ronald Reagan watched the film several days before its screening, on November 5, 1983. He wrote in his diary that the film was "very effective and left me greatly depressed," and that it changed his mind on the prevailing policy on a "nuclear war". The film was also screened for the Joint Chiefs of Staff. A government a
... (read more)
3Timothy Underwood
Thanks for those examples. I have been looking for cases of movies also. Also it is good that you had here an example of something that a lot of people would view as a negative case (making the invention of the hydrogen bomb faster). What surprised me and conflicted with my intuitions is the way that works of art pushing already highly familiar ideas that already had lots of artistic works about them are capable of still having a huge effect if they catch the public imagination in either a way previous works hadn't, or that this particular generation of movie goers hadn't been affected. Obviously The Day After and The Holocaust were not the first movies about those subjects, nor even the first hugely popular and successful movies about those successes (or even in the case of The Day After the first movie that is credited with substantially improving popular awareness on the subject). But despite the fact that it would seem like something which had already been done, there seems to be a clear argument that each had an important effect on the margin. I'm pretty sure it is actually the same case with the classic slavery example of Uncle Tom's Cabin. I mean, I don't know much of anything about the history, but on reflection it would be very surprising to me if it was the first popular novel focused on the theme of slavery being terrible. And there had at that point been a century of abolitionist activity as a central theme of political life. But it still plausibly had an important marginal influence. This makes me update away from my view that writing books pushing specifically an AI safety angle wouldn't be useful because it has already been done and people are aware of the ideas. Though I still think that ideas about how to make sure that there is a decent distribution of resources that can make a post human labor society an actually good thing for almost everyone are far more neglected.
Pablo90

To reasonably conclude that PredictIt's limits are "limits of prediction markets"—as your title asserts—you need to show either that the other existing prediction markets also exhibit these limits, or that there is a fundamental theoretical reason for expecting such limits to be exhibited by any prediction market. As far as I can tell, you do neither. (You do say that «similar analysis is applicable to any [prediction market]», but you never justify this assertion. In fact, of the six problems you note, I think the only one that may be plausibly claimed to be inherent to prediction markets is #4, and even that one may be potentially solvable.)

3SimonM
Agreed - 4/ is solved by allowing margin. (Although margin is trickier if the event can suddenly resolve to 0 or 1 at any time, I think there are even solutions to this)
Pablo40

Of course genetics isn't everything. This is recognized in the third law of behavioral genetics. Researchers who rely on twin studies do not assume otherwise.

Load More