All of alexei's Comments + Replies

alexei
10

This is really good and I found it very useful for what I'm currently working on.

One note: it felt a bit disconnected. And I didn't get the impression that RL is "unreasonably effective."

2Richard_Ngo
Glad to hear it :) I was talking about DL not RL, although I'd also claim that the latter is unreasonably effective. Basically, we throw compute at neural nets, and they solve problems! We don't need to even know how to solve them ourselves! We don't even know what the nets are doing internally! I think this efficacy is as entirely magical as the one in the original paper I was referencing.
alexei
10

Yeah, makes sense. Also note that if Many Worlds is true and quantum immortality exists, you will never (from your own point of view) die.

1Rafael Harth
This is actually not obvious to me, probably because I don't understand thermo-dynamics. My sense was that (provided some assumptions which might or might not turn out false) the universe eventually dies in a heat-death, which after a finite amount of time should happen in all universes.
alexei
30

Yeah, splitting it into two parts would have been better.

What exactly do you mean by "things that try very hard to break down the map/territory distinction"?

alexei
40

Good points. I agree that there are many ways to slice these practices. This goes along with habryka's point that I should have split this post into two parts, which I agree with as well.

alexei
50

I'd predict that most people teach mindfulness horribly wrong. I'd also predict that the way it's usually taught does not resonate with most people, and they end up not doing the thing. (This was true for me the first few times I encountered it.) (Also, I know people who've done meditation for years and they're not much further along than when they started because they're still not doing the thing.) I'd also predict that they didn't do it for long enough. (Conservatively, I'd say you need 6 months to see some re... (read more)

alexei
60

I sympathize. It's a giant and weird project the likes of which the world has not seen in a while. If I wrote down how to implement just what we built so far so that someone could read it an unambiguously translate it into the current product, I think the document would be around 200 pages. And what we implemented was may be ~15% of Eliezer's full vision that he was describing in his document.

By the way, we followed Eliezer's direct vision for only 1.5 years. Then we took matters into our own hands and the design went elsewhere.

Turns out it&... (read more)

alexei
10

What habryka said. Basically you're totally underestimating the complexity of the project and how granular and specific things get if you're to build them in a way Eliezer would approve.

7Adam Zerner
Given that Eliezer, you and habryka are saying what you're saying, out of respect for all of you, I truly do believe that you are right. But it is hard not to be curious when a 55 page document was released and about three years worth of work had been done (meaning that there's notes, designs, code, and mental models that you and the other people who worked on the project have). I can sorta grok the idea that it wouldn't be possible to get every small detail exactly the way Eliezer envisions. But what about using the big document plus everything else for the broad (and medium) strokes, and filling in the details by using ones judgement? The details won't get filled exactly the way Eliezer envisioned, but I'd think that it'd be a decent approximation. And even if it isn't such a great approximation, the broad strokes would still be there, right? To wrap up this thought: I'm having trouble grokking why it would be essential to get all of the small details exactly the way Eliezer envisioned.
alexei
10

It's too easy for people to just recommend their best lawyer friends. I suppose if you really trust your friends not to recommend their lawyer friends just because of the relationship (a big if!) then you could take their advice.

alexei
40

Oh no, totally the same feelings. You get it. :)

However, since then I've gotten over that "should universe" and went back to "is universe", where this is just how people are. Won't be making that mistake twice. Sounds like we learned the same lesson. :)

alexei
20

Yes, it's possible we weren't ideal. On the other hand, sometimes you have to play the hand you're dealt. I don't think disagreement by itself is necesserily bad.

1Said Achmiz
Is it common for an ‘advisor’ to have such pervasive and far-reaching control over what the founder of a startup does…?
alexei
10

Yes about the prestige. That was the realization I had in 2017.

Be careful: I think Arbital as an idea has evolved to be extremely sticky and "obviously good". The antidote is to find a problem that actually exists and people want solved (and ideally will pay for). And only then take parts of Arbital that might provide a solution.

alexei
40

Yes, there is a good case to be made that Eliezer's vision hasn't been fully tried. But I also think it's impossible to try it because the exact design is locked inside Eliezer's head, so he would be the bottleneck. (That is, unless you found someone who thought like him and could be on the team full time. We have tried to find a person like that, but couldn't.)

I maintain that someone doing their own project in this area would be a better bet. And they can take features / inspiration / overall direction from Arbital.

2TAG
if you can't unlock ideas by writing a clear spec, you shouldn't even be trying to run a software project. That woud be like hiring someone who can't code to develop.
5Said Achmiz
Well, Eliezer has access to a keyboard, and a computer, and the Internet, doesn’t he? The design need not remain locked in his head! (“But Eliezer is too busy to type up all of his thoughts!” Well, you (Alexei & the Arbital gang) kept design notes, right? Why not publish them? Or are you keeping them to yourself because you still have plans to develop a project on their basis in the future? In any case, here’s another possibility: have Eliezer explain the thing to someone (perhaps verbally), record it, then publish that!) In short, this seems like an eminently solvable problem; I find ‘impossible’ to be a strange thing to say of it!
alexei
110

We did some work on the community design. That's what Eric Bruylant did part time (slack channel, writing guidelines, etc..). He worked with the Wikipedia community (and other forums) in the past, so he certainly had the right experience. But overall I agree with your sentiment.

alexei
30

Thanks for the comment. Yeah, we definitely planned to make a lot of money. But I think the steps from what we were building to where we would be making money were too indirect / too far.

alexei
30

Sound correct to me. Also, I think it's much easier to start / contribute to a page on Wikipedia. Arbital's pages were trying to be educational and readable, which, I think is a higher bar.

alexei
10

To clarify, I'm not arguing that Tezos is shiny right now. It was shiny during ICO, and now it's possible I wouldn't buy it.

But OCaml was certainly one of the big factors that lept at me. It signalled that they were serious about writing code that could be proven to be correct. (This is in contrast to Ethereum's Solidity.) Basically: 1) I looked at what they were promising to do, and it seemed to have enough additional good things beyond Ethereum, 2) nobody I saw was disputing their tech, so I didn't have to understand it in detail... (read more)

alexei
20

The cost is actually not that high. I spent may be 5-10 hours researching Bitcoin (about 5 hours before I invested; 10 hours total). There aren't that many things one can invest 5-10 hours into and instantly make money. In fact, none of your examples come even close. Those are huge fields that you need to sink a ton of hours into before you can start reaping rewards. And none of them have direct monetary rewards like crypto.

I googled Tezos for a while and still do not have any idea why this has a strong "signal".

Ok, then may be I've ove... (read more)

5Teja Prabhu
I concede that Bitcoin is pretty easy to understand and sanity check (merkle trees aren't that hard to wrap your head around ― I would have invested in Bitcoin in 2012 when I heard about it, but I was in high school and had no disposable income). But sanity checking Tezos is much harder: ― Scaling Tezos I don't know enough to sanity check their scaling strategy or what makes Tezos unique in this respect. Even Ethereum itself is experimenting with zk-SNARKS and Vitalik Buterin wrote a series of articles explaning SNARKS on his medium blog which starts off with an article that says: ― Exploring Elliptic Curve Pairings So far Tezos' Unique Selling Point seems to be that they've used OCaml to implement some way of doing formal verification on smart contracts. But this alone seems like insufficient evidence to conclude that Tezos is shiny. To make matters worse, there seems to be some internal conflict between the co-founders of Tezos. I don't know how I could possibly successfully sanity check Tezos without understanding SNARKS and reading their whitepaper (both of which require non-trivial prerequisites). Perhaps you have the background or access to people who have the background to evaluate Tezos properly. But I certainly do not and I would argue the cost is high enough.
alexei
50

It was around $4 when I wrote the FB post literally two days ago. :D

alexei
60

If I heard correctly that AF forum is moving to LW 2.0, you'll have to solve the math blogging problem. ;) And with the current features you're already 50% there. (Assuming they are working well, which right now it doesn't quite look like that.)

alexei
170

Thanks for the response. After reading it, it's now even more clear to what extent collaborative explanations is just not a thing that can easily work.

Eugen
300

The obvious question is how is it even possible that Wikipedia works at all? If Wikipedia didn't exist in our universe, we would now be tempted walk away from this with a high probability estimate that this concept is simply impossible to pull off due to the various reasons mentioned, yet here we live in a world where Wikipedia is clear evidence to the contrary, and to my knowledge it suffers from many problems you and Qiaochu_Yuan mentioned above. Are we to conclude then, that the sequential nature of the arbital content is the crux here?

As we all k... (read more)

alexei
90

FWIW, I ran into the same issue with Arbital, and very quickly decided to change it to $$. Otherwise, any time you're writing a post about money, it's super inconvinient.

alexei
50
Of course it needs a good admin supporting it

Yup, that's a nonstarter for most casual bloggers.

6Said Achmiz
I meant the platform needs a good admin, not each individual blog. Does Medium not need admins? Does Wordpress (wordpress.com, I mean, not self-hosted Wordpress installs) not need admins? Does Arbital not need admins? What I’m saying is that if, hypothetically, I wanted to create a platform for other people to have blogs on (who needed LaTeX support and so on), I wouldn’t need to develop new software for it, because such a thing already exists (and is very capable).
alexei
30

Huh!! 2015, no less. I'll check them out.

alexei
50

Fun fact: originally Eliezer called the project Zanaduu (a play on Xanadu-doomed).

I'll bet that parts of Arbital will show up across various products (and I've already seen some), but I would be very very surprised if we get something that has the entire package in the next 5 years.

alexei
100
... but if they did, they were not assertive enough in applying it.
... experience / domain knowledge are somewhat underrated in the community compared to generic rationality skills

Yes to both.

And yes, I'd love to see LW 2.0 execute my plan and become a social network. (They already did the first few steps; just instead of math, they did rationality.)

alexei
280

Two features I miss the most are greenlinks (hover over a link to see summary) and claims (vote with probability / agreement).

But I think this question should be answered by LW community needs.

Well, trying to build a system that will dynamically link pages together to form a sequence based on requisites would be hard. But I think basically all other features are very modular.

7Adam Zerner
Huge "yesssss" to greenlinks. Claims I'm not so sure about. People do, and want to, upvote for different reasons. Stating agreement is surely one of them, and claims sounds like a good way to address that need. But what about other needs, like stating appreciation or inspiration? Do we have different types of voting for the different use cases? Does that become feature overkill? I don't mean to imply any answers to these questions, just that I personally don't feel a sense of excitement and confidence about that feature.
habryka
150

I also really want both of these, and have needed to restrain myself from just building them, since I do think for now we should focus on the core experience of the website (and you know, finally actually move to LessWrong.com and properly import all the old content and stuff). But I definitely want to have both of them in the long run.

alexei
30

Yes, there are components one can put together to make it all work well. But there is nothing as simple and as good looking as Medium.

2Adam Zerner
Agreed. Although I'd like to also give a shout out to https://trix-editor.org/.
2Said Achmiz
“Good looking”, of course not, because Medium can afford, and has, a team of designers working on their site’s appearance. With an easy-to-mod platform plus at least one good designer, you can get pretty close to Medium levels of good looks (or even better, as Medium is constrained by its nature to make certain questionable or outright poor design choices). On “simple” I have to disagree. There’s nothing complex about the setup I describe (from the writer’s perspective). (Of course it needs a good admin supporting it—as does any platform with non-trivial capabilities.)
alexei
50

Which version of product are you talking about specifically?

Also, part of the reasoning was that if we had a functioning product, we could try many things with it. (In practice, we only got to try a few.)

It seems to me that all versions of Arbital relied on the hypothesis that many people would create content, but every time you looked at user behavior, you got evidence against that hypothesis. And you paid a lot for that evidence. It would've been much cheaper to ask people if they would create content.

alexei
80

I'm curious if these papers / blogs would have been written at some point anyway, or if they happened because of the call to action? And to what extend was the prize money a motivator?

Not only would Goodhart Taxonomy probably not have been finished otherwise (it was 20 percent written in my drafts folder for months), but I think writing that jump started me writing publicly and caused the other posts Ive written since.

alexei
10

Sounds beautiful, thank you for sharing!

alexei
10

Link please.

2AABoyles
https://aaboyles.github.io/Essays/portfolio/CryonicDemography.html
alexei
80

You're about to flip one now.

Now *that's* how you end a post & a sequence! Well done.

alexei
50

This is kind of like Eliezer's 12th virtue of rationality (the void) taking a human shape.

3Conor Moreton
Loren ipsum
alexei
30

Playing poker at higher levels actually requires one to practice this skill a lot.

alexei
20

Nice, thanks for writing this up.

The prediction is that improving the quality of processing via the principles explained in the book can reduce pain and increase your physical capabilities.

Is there a summary of the principles somewhere?

4Elizabeth
I want to talk more about the pain model in the book, but I'm deliberately not writing up the principles. I don't think people would get much from a summary that's more than what I have here but less than the whole book. Being walked through it was really integral to my getting the benefits.
1Elizabeth
Testing if lw is eating my comments.
alexei
40

Arbital 2.0

Blogging / social media platform.

Initially: 1) make math blogging much nicer, 2) help people connect over similar interests. Eventually: change the shape of the social media and information flowing through it.

If you know math bloggers, I'd appreciate a referral so I could tell them about the platform and see what their needs are.

alexei
60

Also asking "how do you feel about that?" helps, although might come off a bit psycho-analytical if asked repeatedly and directly.

alexei
*10

Looks like at some point one of our scripts did something funky to this page (probably replaced [1] with a link to the page with id 1) and now it's broken.

alexei
*10

One can imagine an agent that is smart about finding and training itself on new features. You seed it with one set of features, but over time it replaces that set with much better features fitting the data. To me it even seems possible that something like that could get to AGI level. This is not "self-modification" in the classic sense, so I'm wondering where that falls in this classification scheme.

alexei
*10

But if we can keep our eyes out for a low-effort way to solve the problem, the return still feels high.

It's very likely that because we haven't seen any solution to this problem, the ones that do exist are not low-effort. This is part of Eliezer's argument (as you'll probably get from the doc).

alexei
*20

I basically agree with everything here.

alexei
*10

Yes, yes, yes. I've recently realized these things too. Very much agree.

alexei
*10

Eric Rogstad's stark disagreement made me realize that there are two ways to interpret this question, and specifically "Less Wrong renaissance" phrase: 1) the effort that goes on at LW.com where they are upgrading and fixing the community and the website, 2) all other efforts to revitalized the broader online community.

alexei
*30

Even if the platform had pros and cons, you'd still need to decide for any given claim whether some piece of evidence is a pro or a con and by how much. I'm not even sure what a good solution to that might look like that isn't basically a reputation system.

1Andrea Gallagher
Again I think I erred in including "reputation system" in the claim. I was trying to draw a distinction between voting up or down on a claim/comment/post and between providing evidence for or against. While I'd like to think it could be evidence all the way down, in reality you would need voting at least at the leaf nodes. And the voting is probably useful at each level. I wasn't trying to make it exclusive, rather that conversational structures to support things like evidence, cruxes, and tests is an unexplored area in the field, while voting systems are both well known and hard to perfect. So the ROI feels higher for the first.
alexei
*10

My main point of disagreement is that it's sometimes hard to say if some evidence is "for" or "against." It might also be subjective. Or it might be _, for which I don't have a word, but an example would be General Relativity as it relates to Newtonian Physics.

1Andrea Gallagher
I imagine you could propose evidence as "for" or "against", and then the discussion steps down a level to the quality and direction of the evidence. This would all need to be hierarchical, and what I call "evidence" may really be a "sub-claim".
alexei
*70

Each leader takes small steps to avoid trading off others' goals too aggressively.

This seems hard, especially depending on what kind of project you are doing. Startups, for example, are often pretty extreme in their trade-offs. Compromising would lead to a sub-par solution.

Load More