All of trist's Comments + Replies

trist20

I guess I didn't make myself at all clear on that point, I ascribe to both of the above!

trist90

Another way to avoid the paradox is to care about other people's satisfaction (more complicated than that, but that's not the point) from their point of view, which encompasses their frame of reference.

Another way perhaps is to restate implementing improvements as soon as possible as maximizing total goodness in (the future of) the universe. Particularly, if an improvement could only be implemented once, but it would be twice as effective tomorrow instead of today, do it tomorrow.

3[anonymous]
I don't see why you wouldn't do it this way, since that's the basic, fundamental moral intuition we derive from our faculty of empathy.
trist30

The probability distribution part is better, though I still don't see how software that uses randomness doesn't fall under that (likewise: compression, image recognition, signal processing, and decision making algorithms).

1jsteinhardt
If the software generates its own randomness (for instance, in JAVA you can do this by creating a new instance of a Random object and calling nextInt(), etc.) then I don't see how this breaks modularity. Compression algorithms like bzip don't promise to make things smaller as part of their contract, they only promise to be lossless. To the extent that a user relies on them becoming smaller consistently, this can lead to trouble, for instance if I expect by inputs of size 10 kilobytes to compress down to 2 kilobytes, and then many of the inputs in a row stay at 10 kilobytes, I can get unexpected load that could create issues. I don't know of many image recognition algorithms that are integrated into a large system without a human in the loop, except perhaps Google Image Search which arguably has a human (the end-user) that filters the results at the end. This is precisely due to their non-modularity: they fail in unexpected and difficult-to-characterize ways, such that any attempt to enforce a contract or abstraction would be probably misguided at this point. The best they can currently promise is "we correctly implement the fast Fourier transform" and leave it up to the programmer to decide whether an FFT is what is merited in a given case. ETA: Another way to put the bzip example which might fit more with your language, is that yes the guarantee of bzip is that it is lossless and that it will make your data smaller as long as the data fit the properties that bzip attempts to exploit, and if that is what we want the contract to be then I would agree that bzip is non-modular.
trist30

Any software that uses randomness requires you to meet a probability distribution over its inputs, namely that the random input needs to be random. I assume that you're not claiming that this breaks modularity, as you advocate the use of randomness in algorithms. Why?

1jsteinhardt
Based on the discusssions with you and Lumifer, I updated the original text of that section substantially. Let me know if it's clearer now what I mean. EDIT: Also, thanks for the feedback so far!
trist10

(idle bemusement)

Does an optimal superintelligence regret? They know they couldn't have made a better choice given its past information about the environment. How is regret useful in that case?

0[anonymous]
An optimal superintelligence has a regret probability of , and it's not actually useful. This regret construction is meant to construct loss functions for strictly non-optimal agents.
trist00

So you're differentiating between properties where the probability of [0 1 2 3] is 1-ɛ while >3 is ɛ and probability distributions where the probability of 0 is 0.01, 1 is 0.003, etc? Got it. The only algorithms that I can think of that require the latter are those that require uniformly random input. I don't think those violate modularity though, as any are of the program that interfaces with that module must provide independently random input (which would be the straightforward way to meet that requirement with an arbitrary distribution).

There's a dif... (read more)

trist30

Requiring that the inputs to a piece of software follow some probability distribution is the opposite of being modular.

What? There is very little software that doesn't require inputs to follow some probability distribution. When provided with input that doesn't match that (often very narrow) distribution programs will throw it away, give up, or have problems.

You seem to have put a lot more thought into your other points, could you expand upon this a little more?

Let me try to express it more clearly here:

I agree that it is both reasonable and common for programs to require that their inputs satisfy certain properties (or in other words, for the inputs to lie within a certain set). But this is different than requiring that the inputs be drawn from a certain probability distribution (in other words, requiring 5% of the inputs to be 0000, 7% to be 0001, 6% to be 0010, etc.). This latter requirement makes the program very non-modular because invoking a method in one area of the program alters the ways in which I am al... (read more)

trist20

The king was proposing that Orin bet 1kc, of which they only have 800c currently, in order to receive 20kc (which is twenty five times their net worth). The 200c debt was what Orin would be reduced to if they were wrong.

0Slider
Yes, that is an oversight. I guess I automatically assumed that money not currently available could end up as incurably lost.
trist170

In such cases I'll say, "Oh! Interesting... how does that work exactly?" It seems to work out alright, and I would guess that other methods of asking for more information without implying that their statement is false are equally effective.

9JQuinton
Yes, "Tell me more" is certainly more effective than saying something like "I don't think that's true". Even if you don't think it's true, following a Socractic dialog will probably be more useful at uncovering untruth without being overtly offensive.
trist40

An addendum to [1], social security tax in the US is capped, with the cutoff being around $105k of individual income, so there may be a local dip there in percentage where the increasing income tax doesn't balance the 11% that goes to social security before that point.

trist20

Might a one half point penalty for down voting change the incentives enough to prevent mass down voting? Perhaps combined with Viliam_Bur's minimum karma suggestion. Generally I favor ideas that don't make more work for the moderators.

(I am not imagining having half karma points, rather docking one karma for every two (or n) down votes.)

7Nornagest
It'd make it somewhat more salient at the very least, but technical patches like these often come with unintended side effects. The moderation burden here is pretty light as it stands; as long as the tools exist to do the analysis I don't feel it's an undue burden on the mods to empower them to deal with things like this. I'll also note that it's historically been a lot easier to get mod time than to get dev time.
trist40

Weak evidence though, easily overcome by being open to whatever things your tribe denounces.

trist10

Nothing like a good idea to get lots of names.

trist00

The "be a sheep" voting system is also known as assignment voting.

0ntroPi
I know it as Liquid Democracy or http://en.wikipedia.org/wiki/Delegative_democracy
trist50

How can we share evidence effectively? More generally, how can aspiring human rationalists make group decisions?

trist20

"Arrogant pride", or at least arrogance, is listed among the traits already, that doesn't add anything to the meaning.

Imagine I'm writing a computer program that models people. People who exhibit a high number of these traits gain the label narcissist. Does this label allow me to make better or more efficient predictions about the person than the individual traits? What sorts of predictions?

3Algernoq
The label is an efficient way of describing someone with most of or all of these traits. If your computer is memory-limited, storing the label "narcissist" may be more efficient than storing answers to all of a list of questions. Someone who shows these traits will probably continue to show these traits. Additionally, someone who shows most of these traits probably shows the other traits as well.
trist00

A little brief reading elsewhere still doesn't explain what narcissist means here. Is it just a word that means "this group of symptoms (presumably commonly found together)"? If it doesn't mean anything else, its use carries strong negative connotations that distract from the traits it encompasses.

The argument would be stronger if I could use the "narcissistic personality disorder" test for Petunia too,

I was under the impression that you identified Petunia as narcissistic first, and was using that as a predictor for Harry's, my confusion.

3Algernoq
"Narcissist" is just a word! Just kidding. It means "arrogant pride". Here, it also means "arrogant pride as a defense mechanism against parental emotional neglect". When I first read about narcissistic parents, I pattern-matched on Petunia laughing at Harry and Harry being kind of arrogant. I expected to find examples in HPMOR for Harry showing about 1/2 to 2/3 of a list of narcissist traits. I was surprised to find examples for every item on the list.
trist40

While I enjoyed reading this, amused and intrigued, I am somewhat hesitant to accept it, lacking a search for traits that are anti-correlated and without exploring alternative theories explaining these traits. I'm also a little confused by

I predicted that if my theory is correct then Harry would have a narcissistic personality. To test this, I found a list of personality traits that describe a narcissist (by Googling “children of narcissistic parents” and clicking the first link),

wouldn't this be a list of traits of children of narcissistic parents? If... (read more)

4Algernoq
Thanks for the feedback. To address your points: 1. Traits that are anti-correlated with narcissism include the opposites of the "symptoms" listed. For example, Hermione is not at all narcissistic. She is not grandiose: she reminds Harry that they are young and shouldn't do anything important yet. She is not selfish: she helps Hufflepuffs with homework. She doesn't become furious when criticized: she reacts to harsh criticism by being sad and retreating (instead of attacking). Etc. 2. Identifying Harry as "child of a narcissistic parent" seemed to have strong predictive power, and helped me understand people with similar personalities in the real world. There may be other theories that are simultaneously correct. One possible other theory is that Harry and his parents have a "healthy, loving" relationship, and that Harry's narcissism is due to the Dark Lord and the scar, not his parents' influence. Harry's mother's insecurity and neglect of Harry's ego needs is evidence against this theory. 3. Though the search and website are for "children of narcissistic parents", the "symptoms" listed are "Symptoms of Narcissistic Personality Disorder". I argue that (A.) Harry is very narcissistic and (B.) Petunia is a "narcissistic parent". I used the "narcissistic personality disorder" test for Harry to support (A.) and matching to a description of "narcissistic parent relationship to a child" to support (B.). The argument would be stronger if I could use the "narcissistic personality disorder" test for Petunia too, but she is in the book so little that this is difficult. Instead, I argue that the Harry-Petunia relationship fits a pattern where Petunia seeks emotional validation from others (Harry or Michael), does not meet Harry's ego needs (respect, understanding), and puts Harry in a role of caring for her ego needs (for example, solving the disagreement with Michael in Ch. 1). 4. As far as "useful", I don't know -- it depends on your goals. In "How to Hire the Best
trist80
  • Assigning probabilities of falsehood is counter-intuitive to many, using two statements would allow for the typical direct assignment of truth.

You can still assign probabilities of truth with three statements, they would merely sum to two instead of one.

trist30

My cursory understanding is that none of these proofs apply to rating systems, only ranking systems, correct?

5badger
Arrow's theorem doesn't apply to rating systems like approval or range voting. However, Gibbard-Satterthwaite still holds. It holds more intensely if anything since agents have more ways to lie. Now you have to worry about someone saying their favorite is ten times better than their second favorite rather than just three times better in addition to lying about the order.
trist20

New programmers (not jimrandomh), be wary of line counts! It's very easy for a programmer who's not yet ready for a 10k line project to turn it into a 50k lines. I agree with the progression of skills though.

0jimrandomh
Yeah, I was thinking more of "project as complex as an n-line project in an average-density language should be". Bad code (especially with copy-paste) can inflate inflate line numbers ridiculously, and languages vary up to 5x in their base density too.
trist10

You mean that most cognitive skills can be taught in multiple ways, and you don't see why those taught by programming are any different? Or do you have a specific skill taught by programming in mind, and think there's other ways to learn it?

4Lumifer
There are a whole bunch of considerations. First, meta. It should be suspicious to see programmers claiming to posses special cognitive skills that only they can have -- it's basically a "high priesthood" claim. Besides, programming became widespread only about 30 years ago. So, which cognitive skills were very rare until that time? Second, "presenting a tight feedback loop where ... the mistake quickly gets thrown in your face" isn't a unique-to-programming situation by any means. Third, most cognitive skills are fairly diffuse and cross-linked. Which specific cognitive skills you can't get any way other than programming? I suspect that what the OP meant was "My programmer friends are generally smarter than my non-programmer friends" which is, um, a different claim :-/
trist00

On your last point, no. To put it colloquially, the simpler answer is more likely.

In practical terms, saying that all binary choices without evidence causes conflicts. Namely, if there's a 50/50 chance that your consciousness dissolves when you die, and a 50/50 chance that a hidden FAI captures your brain state, and a 50/50 chance that a hidden UFAI captures your brain state. That implies that in every case that a FAI captures your brain state so does a UFAI.

trist30

If the farmer is actually a subsistence farmer, they save their own seed, so they don't care about the price of seed, nor would they buy single generation seed (say of a new crop or variety) knowingly. However, if someone nearby plants single generation seed, they can end up with genetic material in their variety of that crop, which cuts their germination (or seed baring) rates the following season.

trist230

Subsistence farmers don't trade for their sustenance, they farm what they subsist upon. So perhaps the moral is do be a subsistence farmer...

trist20

Also, avoiding dying in ways that destroy brain state. I'm not sure how probable those are, or how easy they are to avoid, and if that includes dementia (and so on) it gets rather common and tricky.

2Froolow
This is very true. I agonised about including a, 'Structure your life in such a way that your minimise the probability of a death which destroys your brain' option, but decided in the end that a pedant could argue that such a change to your lifestyle might decrease your total lifetime utility and so isn't worth it for certain probabilities of cryonics' success.
trist10

Because your cars run on gasoline and would have filled the tunnels with choking fumes, without either (1) a big expensive ventilation system, or (2) expensive electrified rails that would...impose friction costs?

For 2) you can use magnetic levitation: Inductrack which now manifesting out as Skytran. (Costs are about 1/50th your transportation mass in magnets.)

trist20

I know at the moment it seems to me that the colors are far enough apart that light conditions at my PC are not the main problem. Your monitor emits light, so the light conditions matter less, mostly needing to overcome the ambient light (laptop in sun).

Most things don't produce their own color though, they reflect varying amounts of the incoming spectrum. If that incoming spectrum is different, the outgoing spectrum is different. You can take advantage of that in various ways, but it might also confound the question of what color "is" this ob... (read more)

-1ChristianKl
At the moment I haven't tested. I spent a total of 7 hours with the average of 5 minutes per day on the Anki cards and I seem to be getter better at color distinction. Every card provides a binary choice. I have cards that present me with two color words and a large circle that's filled with the corresponding color. The difference of the colors is at the beginning stage where I'm still at least a total 32 different hex values. I also have cards that ask for the hex value of the colors. There were some days were I traveled and used my laptop in other light conditions. They weren't a problem. For the time in 7 years I created cards to distinguish 4dc636 from 4dc637. That might run into issues with light conditions. I don't know whether it does and whether the human mind is trainable to distinguish colors as finely, but I will find out if I continue spending my 5 minutes every day. I don't like "is" anyway for the reasons Korzybski layd out. I want to increase the amount of bits I perceive through the visual channel. It's an open experiment. The outcome might be that I have color distinction in a few years that allows me to impress people with stunts. I might learn something valuable about colors that can be made into scientific paper or blog post. I also expect that I will get better at usability design even if I don't get superhuman color perception abilities out of the project. But you are right that having data about the light conditions would be good. I opened a thread on the QS forum about the search for a proper tool.
trist10

Under different light contexts an reflective object might be closer to either midnight blue or navy. Have you attempted using paint chips or something to test yourself under sunlight versus florescent light or anything?

Also, for sound perception: sox(1)

-1ChristianKl
I know at the moment it seems to me that the colors are far enough apart that light conditions at my PC are not the main problem. My notebook is slightly differently configured and I didn't judge many Anki cards wrongly when answering on the notebook instead of my main monitor.
trist30

The relevant studies all seem to be behind paywalls, but the graphs from this one looked promising.

Jay L. Zagorsky (2007): "Do You Have to Be Smart to Be Rich? The Impact of IQ on Wealth, Income and Financial Distress." Intelligence, 35 (5), 489-501.

3Kaj_Sotala
See also Anders Sandberg's commentary on that paper.
trist40

If someone starts a meetup in a small town, it would not be difficult for them to get a newspaper article talking about the event. Though I'm not sure Wikipedians would consider little-tiny-newspaper to be adequate coverage...

trist20

I admit to hyperbole, now, with a little more thought, I would have worded it differently. Both to clarify that it's pretty far down on our list of societal problems, and that it's more an individual level mistake rather than a systematic one (though there are systematic benefits to fewer flush toilets).

trist40

Translate it to "In x% of new non-urban houses, there are options better than flush toilets." My confidence in my confidence assignment isn't very high yet though, so I am quite open to being overconfident.

And obviously both lists are non-exhaustive.

  • Flush toilets handle large numbers of people for a long time fairly easily.
  • Flush toilets get clogged.
trist50

I suppose my actual belief is that flush toilets are a mistake outside of urban areas, I don't have much experience with urban living or what other poop strategies could work with it.

Advantages, flush toilets:

  • Provide easy long distance transport of human waste in urban environments.
  • Exchanges weekly-to-yearly chores for purchased services.

Disadvantages, flush toilets:

  • Create additional dependency on water (and by extension outside water districts, electricity).
  • Turn (vast amounts of) drinking water into black water.
  • Create a waste product from human m
... (read more)
0Lumifer
You forgot the "not having the whole village die from a cholera outbreak" part :-/
0rthomas6
That clears things up a lot, and I changed my downvote to an upvote. EDIT: To be clear, I disagree with you. My thoughts on your disadvantages list: * Flush toilets do create additional dependency on water, however if one already has running water and depends on it for drinking and washing, how significant is the additional water dependency for flush toilets? * The reason flush toilets use potable water is an economic one. It is simply cheaper to use one unified water system instead of two, when someplace already has running water. The cost of the wasted drinking water is negligible compared to the cost of building a second plumbing system. * This point is the most interesting to me. I have no information on the usefulness of human manure, and would be interested to know if human manure would have a comparable market value to cattle manure or synthetic fertilizer. I am skeptical because of the tendency for human waste to carry human diseases. * I have no disagreements with this disadvantage, but simply feel that the vast, vast majority of people would be willing to pay for the extra cost in housing if they already had indoor plumbing.
5Error
I still think you're overconfident, so upvoting, but the justification is convincing enough to make me update from near-zero to something noticeably above zero. I never thought of it quite that way.
trist470

Irrationality Game: (meta, I like this idea)

Flush toilets are a horrible mistake. 7b/99%

2faul_sname
Upvoted for "horrible". I don't see how their impact is all that bad -- at 3.5 GPF (which is standard), that means that, for example, all of the flush toilets in California together use about 750,000 acre-feet of water per year. Compared to the 34 million acre feet used in the same state for agriculture, it's clear that flush toilets use a significant but still pretty small fraction of the water in the state, but "horrible" is an overstatement. (I choose California because it is a populous state that regularly has water shortages).
4Slackson
"If it's yellow let it mellow, if it's brown flush it down." This is one of the first things I remember learning, growing up with tank water.
4ChristianKl
Based on what reasoning?
2rthomas6
How is this not just a preference?
trist30

Most teaching jobs around here involve significant use of internet capable machines for grading, communication with other teachers and administration, and increasingly communication with students. Mathematics is probably more resistant to online teaching materials than most subjects though, and you may be able to find a school that eschews such things.

trist30

I wonder how much people's interactions with other aspiring rationalists in real life has any effect on this problem. Specifically, I think people who have become/are used to being significantly better at forming true beliefs than everyone around them will tend to discount other people's opinions more.

trist40

New datapoint on mass downvoting:

Sometime between this comment and my last comment, approximately all of my comments were downvoted exactly once. Seems kinda strange.

(I don't have anything that I want to post to Main prepared anyway, so karma's kinda a moot point, but I hoped this could be helpful if anyone ever does look into it, and times are included in downvote logs.)

Edit: Hehe! And within ten minutes, this one joined the rest of them...

trist20

Perhaps the reference is to "nutritional yeast", which are all dead, and won't impact your gut bacteria aside from being provided with more nutrients.

0juliawise
I was thinking of bread, actually. Not that bread is the greatest for you, but the problem isn't the yeast (which are dead, anyway).
trist160

The adventurer probably does the most for me, finding new paths and places and people brings such delight. My conscious identification as a person sidestepped a bout of gender-confusion when I realised I hadn't ever identified as man or woman, merely with pieces of each.

I'm less sure about, say, my combination of someone who "gets it done" and "doesn't show imperfect work". The majority of interesting work that gets done is done coincidentally, because it needs doing, and isn't up to my standards. I've been experimenting with ways to ov... (read more)

2Vika
The adventurer identity has been a key subset of the "try things" identity for me. Not every new attempt can be classified as an adventure, though, so an "explorer" identity might be more generally applicable. It increases the playfulness and creativity aspects of trying things. Openness is a very useful identity, I'm glad you are developing it!
1MalcolmOcean
Social reinforcement for learning to be more open/vulnerable! :) I think the imperfect work thing is a huge barrier for many people, and I would guess that both identity shifts and commitments would help here, and their effects would sum/multiply.
trist60

I've never used Beeminder, but I find social commitment works well instead. Even teling someone who has no way to check aside from asking me helps a lot. That might be less effective if you're willing to lie though.

An alternative would be to exchange commitments with a friend, proportional to your incomes...

trist40

There has been major progress with at least one autoimmune disorder over the last 30 years. Even if there has not been an outright cure, the life expectancy of someone with HIV/AIDS, who can get treatment, is far greater now.

edit: clarifying, in case the downvoter didn't understand the combination I responded to.

trist50

Update on the collaboration:

One person has contacted me so far. We're each prototyping to our own vision with plans to share our results (with eachother at least) at some point. We'd love to exchange previews with more people, please don't let our working on it stop you from prototyping your own vision of how it might work.

trist20

And I completely agree that at this point it would be more efficient to find new audience at universities.

Less time required to reach a given number of people who are going to join in, agreed. Yet the translation can help raise the sanity waterline of a group of people that would not even consider coming to a 'rationality meetup'. I go to meetups because of the sequences, because it's worth a three to five hour journey to hang out with people who share that.

trist60

The people who gain the most from structured arguments are the people who don't need to sift through ten blog posts and hundreds of comments. The gains for the writers are more along the lines of less time reiterating arguments in different contexts.

trist100

I've been working on a tool like this. Done well it would be applicable to more than just debate... If folks want to collaborate, I'm interested.

5trist
Update on the collaboration: One person has contacted me so far. We're each prototyping to our own vision with plans to share our results (with eachother at least) at some point. We'd love to exchange previews with more people, please don't let our working on it stop you from prototyping your own vision of how it might work.
trist20

Hence the actually useful numbers bit! Yet I do care to some extent, if for some reason I end up there in future, just less then everyone here and now. Maybe one could weight populations by inverse distance?

trist30

That's not accurate; did you mean 13/10000?

Thanks, fixed.

I have a hard time seeing people as replaceable, much less easially. Even between two people who fit some abstracted ideal, one won't replace another. Leaving that aside though, I think that the difficulty is more in finding the people who fit that ideal than their actual existence.

trist30

Of course... I thought 100 was meant to be the global mean. Lynn set Great Britian's mean, nothing like a flexible definition!

The (not very good) data doesn't bear out a 90ish global mean though, the sub-90 IQ countries are much lower population than over 90. To be pessimistic I'd take another half sigma. (92.5)

  • World Population: 7 billion
  • 145+ IQ (1/4200): 17 million
  • Male (1/2): 8 million
  • College-aged (1/10): 800 thousand
  • Normal weight (3/5): 480 thousand

Actually useful numbers may be able to be obtained by using more locale specific filters.

4Creutzer
Who exactly cares about intelligent people half-way across the globe anyway, when personal relationships (and the possibility of finding people with whom those are possible) are the issue?
trist40
  • World Population: 7 billion
  • 145+ IQ (13/10000): 93 million
  • Male (1/2): 46 million
  • College-aged (1/10): 4 million
  • Normal weight (3/5): 2 million

Transhumanist values are probably higher than average in that group, but I have no idea of numbers there. Clicking with you and a more refined definition of attraction I can't speak to, but if you've come in contact with 5 in your time at college... There's still lots.

gwern110

145+ IQ (13/1000ths): 93 million

I'm guessing that's from a base of 100? If so, you're off by almost a standard deviation there: the mean world IQ is very far from Western normed 100s. IIRC, the population weighted estimate from the Lynn national IQ estimates puts the global mean at maybe 90. That's going to affect the tails like 145+ a lot.

7[anonymous]
That's not accurate; did you mean 13/10000? Given that a couple were taken and a couple were incompatible for various other reasons, that I expect a higher proportion of guys to be taken as I get older, and that I will never be in such a high-density environment again... I really don't think 1 real prospect every couple of years, who may or may not work out as an actual relationship, is a high hit rate at all. Certainly not high enough that I would ever consider someone I was in a successful relationship with to be "easily replaceable."
Load More