Comment author: Acty 31 August 2015 11:45:59PM 2 points [-]

As a judoka, this really spoke to me and was a useful analogy - thankyou very much for it!

My own idea of what good mental posture looks like includes some idea of the way you model yourself. One of my biggest failure modes is when I slip into seeing myself as 'random useless seventeen-year-old' and therefore acting as I expect a random useless seventeen year old to act (ineffectively) or waiting to get permission before I do things. When I manage to change into seeing-myself-as-agent mode, my productivity and rationality gets supercharged compared to the aforementioned state. It has funny side effects - for instance, I notice I walk faster and tend to spin on my heels and clap my hands together when I'm being agenty, whereas I stroll and gesture vaguely when I'm being useless. I speak more precisely when I'm in agenty-mode, and replace 'um/er/uh' with silent pauses or 'hmm'. This indicates to me that it's not just a single mental action, but a whole different stance.

I think it's similar to what is spoken about in HPMOR with most people just playing a role and doing what they think someone in that role should do, but others genuinely optimising - but I don't think I've escaped the mode of playing a role, I just sometimes manage to play the role of an agenty person rather than the role of a useless person. It turns out that if you play the role of someone who optimises everything and Gets Stuff Done, you get stuff done. (Sometimes.)

This definitely feels like two very different mental postures. I'm not actually sure how I induce the agenty state from the ineffective state, but I have identified a number of things that might have to do with it, from social pressure, to bright lights, to having a solid idea of what agentyness looks like from observing good role models. The last idea (watching a role model and knowing what agentyness looks like) was reinforced in my mind when I heard a friend saying similar things recently, so to improve my mental posture I'm going to try and watch more awesome people work so I get an idea of what awesomeness looks like, and then try to play that role more and the 'useless kid' role less. I also really like your suggestions!

Comment author: ErikM 25 July 2015 08:50:37PM 4 points [-]

I think locking out anyone who might be a criminal, when you have the power to potentially stop them being a criminal and their home country doesn't, is morally negligent. (I'm your standard no-frills utilitarian; the worth of an action is decided purely by whether you satisfied people's preferences and made them happy. Forget "state's duty to the citizens", the only talk of 'duty' I really entertain is each of our duty to our fellow humans. "The White Man's Burden" is a really stupid idea because it's every human's responsibility to help out their fellow humans regardless of skin colour.) I think it doesn't matter whether you decreased or increased crime on either side of a border, since borders are neither happiness nor preferences and mean nothing to your standard no-frills utilitarian type. I just care about whether you decrease crime in total, globally.

Let me try to briefly convince you of why there should be a state's duty to citizens from a utilitarian perspective, also corresponding greater concern about internal than external crime:

1) A state resembles a form of corporate organization with its citizens as shareholders. It has special obligations by contract to those shareholders who got a stake on the assumption that they would have special rights in the corporation. Suddenly creating new stock and giving it to to non-shareholders, thereby creating new shareholders, would increase the utility of new shareholders and decrease the utility of old shareholders to roughly the same extent because there is the same amount of company being redistributed, but would have the additional negative effect of decreasing rule of law, and rule of law is a very very good thing because it lets people engage in long-term planning and live stable lives. (There is no such problem if the shareholders come together and decide to create and distribute new stock by agreement - and to translate back the metaphor, this means that immigration should be controlled by existing citizens, rather than borders being declared to "mean nothing" in general.)

2) A state is often an overlay on a nation. To cash those terms out: A governing entity with major features usually including a legal code and a geographically defined and sharply edged region of influence is often an overlay on a cluster of people grouped by social, cultural, biological, and other shared features. ("Nation" derives from those who shared a natus.) Different clusters of people have different clusters of utility functions, and should therefore live under differing legal codes, which should also be administrated by members of those clusters whom one can reasonably expect to have a particularly good understanding of how their fellow cluster-members will be happiest.

3) Particularly where not overlaid on nations, separate states function as testbeds for experiments in policy; the closest thing one has to large-scale controlled experiments in sociology. Redistributing populations across states would be akin to redistributing test subjects across trial arms. The utilitarian thing to do is therefore to instead copy the policies of the most successful nations to the least successful nations, then branch again on previously unexplored policy areas, which each state maintaining its own branch.

Comment author: Acty 27 July 2015 11:14:22PM *  2 points [-]

--

Comment author: advael 27 July 2015 09:01:09PM 0 points [-]

Oh, I guess I misunderstood. I read it as "We should survey to determine whether terminal values differ (e.g. 'The tradeoff is not worth it') or whether factual beliefs differ (e.g. 'There is no tradeoff')"

But if we're talking about seeing whether policies actually work as intended, then yes, probably that would involve some kind of intervention. Then again, that kind of thing is done all the time, and properly run, can be low-impact and extremely informative.

Comment author: Acty 27 July 2015 10:24:18PM *  0 points [-]

--

Comment author: Jiro 26 July 2015 05:33:59PM *  1 point [-]

That's why I don't want to make such a society. I don't want to do it. It is a crazy idea that I dreamed up by imagining all the things that I want, scaled up to 11. It is merely a demonstration of why I feel very strongly that I should not rely on the things I want

Wait a minute. You don't want them, or you do want them but shouldn't rely on what you want?

And I'm not just nitpicking here. This is why people are having bad reactions. On one level, you don't want those things, and on another you do. Seriously mixed messages.

Also, if you are physically there with your foot on someone's toe, that triggers your emotional instincts that say that you shouldn't cause pain. If you are doing things which cause some person to get hurt in some faraway place where you can't see it, that doesn't. I'm sure that many of the people who decided to use terrorism as an excuse for NSA surveillance won't step on people's toes or hurt any cats. If anything, their desire not to hurt people makes it worse. "We have to do these things for everyone's own good, that way nobody gets hurt!"

Comment author: Acty 26 July 2015 06:55:12PM *  0 points [-]

--

Comment author: btrettel 25 July 2015 02:06:50PM *  4 points [-]

The best non-mathematical introduction I have seen is Shape and Flow: The Fluid Dynamics of Drag. This book is fairly short; it has 186 pages, but each page is small and there are many pictures. It explains some basic concepts of fluid dynamics like the Reynolds number, what controls drag at low and high Reynolds numbers, why golf balls (or roughened spheres in general) have less drag than smooth spheres at high Reynolds number (this does not imply that roughening always reduces drag; it does not on streamlined bodies as is explained in the book), how drag can decrease as you increase speed in certain cases, how wind tunnels and other similar scale modeling works, etc.

You could also watch this series of videos on drag. They were made by the same person who wrote Shape and Drag. There is also a related collection of videos on other topics in fluid dynamics.

Beyond that, the most popular undergraduate textbook by Munson is quite good. I'd suggest buying an old edition if you want to learn more; the newer editions do not add anything of value to an autodidact. I linked to the fifth edition, which is what I own.

I'll offer a few possibilities about why fluids is generally seen as less attractive than QM, but I want to be clear that I think these ideas are all very tentative.

This study suggests that in an artificial music market, the popularity charts are only weakly influenced by the quality of the music. (Note that I haven't read this beyond the abstract.) Social influence had a much stronger effect. One possible application of this idea to different fields is that QM became more attractive for social reasons, e.g., the Matthew effect is likely one reason.

The vast majority of the field of fluid mechanics is based on classical mechanics, i.e., F = m a is one of the fundamental equations used to derive the Navier-Stokes equations. Maybe because the field is largely based on classical effects, it's seen as less interesting. This could be particularly compelling for physicists, as novelty is often valued over everything else.

I've also previously mentioned that fluid dynamics is more useful than quantum mechanics, so people who believe useless things are better might find QM more interesting.

There also is the related issue that a wide variety of physical science is lumped into the category "physics" at the high school level, so someone with a particular interest might get the mistaken impression that physics covers everything. I majored in mechanical engineering in college, and basically did it because my father did. My interest even when I was a teenager was fluids, but I hadn't realized that physicists don't study the subject in any depth. I was lucky to have picked the right major. I suppose this is a social effect of the type mentioned above.

(Also, to be clear, I don't want to give the impression that more people do QM than fluids. I actually think the opposite is more likely to be true. I'm saying that QM is "cooler" than fluids.)

Fluid mechanics used to be "cooler" back in the late 1800s. Physicists like Rayleigh and Kelvin both made seminal contributions to the subject, but neither received their Nobel for fluids research. I recall reading that two very famous fluid dynamicists in the early 20th century, Prandtl and Taylor, were recommended for the prize in physics, but neither received it. These two made foundational contributions to physics in the broadest sense of the word. Taylor speculated the lack of Nobels for fluid mechanics was due to how the Nobel prize is rewarded. I also recall reading that there was indications that the committee found the mathematical approximations used to be distasteful even when they were very accurate. Unfortunately those approximations were necessary at the time, and even today we still use approximations, though they are different. Maybe the lack of Nobels contributes to fluids not being as "cool" today.

Comment author: Acty 25 July 2015 08:05:16PM *  2 points [-]

Ooh, yay, free knowledge and links! Thankyou, you're awesome!

The linked study was a fun read. I was originally a bit skeptical - it feels like songs are sufficiently subjective that you'll just like what your friends like or is 'cool', but what subjects you choose to study ought to be the topic of a little more research and numbers - but after further reflection the dynamics are probably the same, since often the reason you listen to a song at all is because your friend recommended it, and the reason you research a potential career in something is because your careers guidance counselor or your form tutor or someone told you to. And among people who've not encountered 80k hours or EA, career choice is often seen as a subjective thing. It'd be like with Asch's conformity experiments where participants aren't even aware that they're conforming because it's subconscious, except even worse because it's subconscious and seen as subjective...

That seems like a very plausible explanation. There could easily be a kind of self-reinforcing loop, as well, like, "I didn't learn fluid dynamics in school and there aren't any fluid dynamics Nobel prize winners, therefore fluid dynamics isn't very cool, therefore let's not award it any prizes or put it into the curriculum..."

At its heart, this is starting to seem like a sanity-waterline problem like almost everything else. Decrease the amount that people irrationally go for novelty and specific prizes and "application is for peasants" type stuff, and increase the amount they go for saner things like the actual interest level and usefulness of the field, and prestige will start being allocated to fields in a more sensible way. Fluid dynamics sounds really really interesting, by the way.

Comment author: Journeyman 25 July 2015 06:15:45AM *  2 points [-]

My response is the friendly version, and I think that it is actually relatively mild considering where I am coming from. I deleted one sentence, but pretty much the worst I said is to call Acty's position "repugnant" and engage in some sarcasm. I took some pains to depersonalize my comment and address Acty's position as much as possible. Most of the harshness in my comment stems from my vehement disagreement with her position, which I did back up with arguments. I invited Acty to correct my understanding of her position.

I think Acty is a fundamentally good person who is misled by poor moral frameworks. I do not know any way to communicate the depth of my moral disagreement without showing some level of my authentic emotional reaction (though very restrained). Being super-nice about it would fail to represent my degree of moral disagreement, and essentially slash her tires and everyone else's. I realize that it might be tough for her to face so much criticism in a welcome thread, especially considering that some of the critics are harsher than me. But there is also potential upside: on LW, she might find higher quality debate over her ideas than she has before.

Your hypothetical response is a good start, but it fails to supply moral criticism of her stance that I consider necessary. Maybe something in between yours and mine would have been ideal. Being welcoming is a good thing, but if "welcoming" results in a pass on really perverse moral philosophy, then perhaps it's going too far... I guess it depends on your goals.

Comment author: Acty 25 July 2015 11:32:02AM *  0 points [-]

--

Comment author: RichardKennaway 25 July 2015 08:00:19AM 3 points [-]

My intuitions say that specialism increases output, so we should have an all-controlling central state with specialist optimal-career-distributors and specialist psychologist day-planners who hand out schedules and to-do lists to every citizen every day which must be followed to the letter on pain of death and in which the citizens have zero say.

"Greetings, Comrade Acty. Today the Collective has decreed that you..." Do these words make your heart skip a beat in joyous anticipation, no matter how they continue?

Have you read "Brave New World"? "1984"? "With Folded Hands"? Do those depict societies you find attractive?

To me, this seems like a happy wonderful place that I would very much like to live in.

Exinanition is an attractive fantasy for some, but personal fantasies are not a foundation to build a society on.

What I can do is think: a lot of aspects of the current world (war, poverty, disease etc) make me really angry and seem like they also hurt other people other than me, and if I were to absolutely annihilate those things, the world would look like a better place to me and would also better satisfy others' preferences. So I'm going to do that.

You are clearly intelligent, but do you think? You have described the rich intellectual life at your school, but how much of that activity is of the sort that can solve a problem in the real world, rather than a facility at making complex patterns out of ideas? The visions that you have laid out here merely imagine problems solved. People will not do as you would want? Then they will be made to. How? "On pain of death." How can the executioners be trusted? They will be tested to ensure they use the power well.

How will they be tested? Who tests them? How does this system ever come into existence? I'm sure your imagination can come up with answers to all these questions, that you can slot into a larger and larger story. But it would be an exercise in creative fiction, an exercise in invisible dragonology.

And all springing from "My intuitions say that specialism increases output."

I'm going to pursue the elimination of suffering until the suffering stops.

Exterminate all life, then. That will stop the suffering.

I'm sure you're really smart, and will go far. I'm concerned about the direction, though. Right now, I'm looking at an Unfriendly Natural Intelligence.

Comment author: Acty 25 July 2015 10:02:39AM *  1 point [-]

--

Comment author: Squark 22 July 2015 07:38:58PM *  2 points [-]

I value unity for its own sake...

I sympathize with your sentiment regarding friendship, community etc. The thing is, when everyone are friends the state is not needed at all. The state is a way of using violence or the threat of violence to resolve conflicts between people in a way which is as good as possible for all parties (in the case of egalitarian states; other states resolve conflicts in favor of the ruling class). Forcing people to obey any given system of law is already an act of coercion. Why magnify this coercion by forcing everyone to obey the same system rather than allowing any sufficiently big group of people choose their own system?

Moreover, in the search of utopia we can go down many paths. In the spirit of the empirical method, it seems reasonable to allow people to explore different paths if we are to find the best one.

I would not actually be awfully upset if the FAI did my homework for me...

I used "homework" as a figure of speech :)

Being told "you're not smart enough to fight dragons, just sit at home and let Momma AI figure it out" would make me sad.

This might be so. However, you must consider the tradeoff between this sadness and efficiency of dragon-slaying.

So really, once superintelligence is possible and has been made, I would like to become a superintelligence.

The problem is, if you instantly go from human intelligence to far superhuman, it looks like a breach in the continuity of your identity. And such a breach might be paramount to death. After all, what makes tomorrow you the same person as today you, if not the continuity between them? I agree with Eliezer that I want to be upgraded over time, but I want it to happen slowly and gradually.

Comment author: Acty 25 July 2015 03:18:39AM *  1 point [-]

I do think that some kind of organisational cooperative structure would be needed even if everyone were friends - provided there are dragons left to slay. If people need to work together on dragonfighting, then just being friends won't cut it - there will need to be some kind of team, and some people delegating different tasks to team members and coordinating efforts. Of course, if there aren't dragons to slay, then there's no need for us to work together and people can do whatever they like.

And yeah - the tradeoff would definitely need to be considered. If the AI told me, "Sorry, but I need to solve negentropy and if you try and help me you're just going to slow me down to the point at which it becomes more likely that everyone dies", I guess I would just have to deal with it. Making it more likely that everyone dies in the slow heat death of the universe is a terribly large price to pay for indulging my desire to fight things. It could be a tradeoff worth making, though, if it turns out that a significant number of people are aimless and unhappy unless they have a cause to fight for - we can explore the galaxy and fight negentropy and this will allow people like me to continue being motivated and fulfilled by our burning desire to fix things. It depends on whether people like me, with aforementioned burning desire, are a minority or a large majority. If a large majority of the human race feels listless and sad unless they have a quest to do, then it may be worthwhile letting us help even if it impedes the effort slightly.

And yeah - I'm not sure that just giving me more processor power and memory without changing my code counts as death, but simultaneously giving a human more processor power and more memory and not increasing their rationality sounds... silly and maybe not safe, so I guess it'll have to be a gradual upgrade process in all of us. I quite like that idea though - it's like having a second childhood, except this time you're learning to remember every book in the library and fly with your jetpack-including robot feet, instead of just learning to walk and talk. I am totally up for that.

Comment author: btrettel 21 July 2015 07:47:48PM *  3 points [-]

Quantum mechanics is esoteric and alien and weird and COOL

To be honest, I found QM to be the least interesting subject of all physics which I've learned about.

Also, I don't think the features you highlighted work either. Fluid dynamics has loads of counterintuitive findings, perhaps even more so than QM, e.g., streamlining can increase drag at low Reynolds numbers, increasing speed can decrease drag in certain situations ("drag crisis"). Fluids also has plenty of esoteric concepts; very few people reading the previous sentence likely know what the Reynolds number or drag crisis is.

Physicists, even astrophysicists, know little more about how rockets work than educated laymen. Rocketry is part of aerospace engineering, of which the foundation is fluid dynamics. Maybe rocketry is a counterexample, but I don't really think so, as there are a lot more people who think rockets are interesting than who know what a de Laval nozzle is. Even that has some counterintuitive effects; the fluid accelerates in the expansion!

Comment author: Acty 25 July 2015 03:01:27AM *  2 points [-]

You make me suddenly, intensely curious to find out what a Reynolds number is and why it can make streamlining increase drag. I am also abruptly realising that I know less than I thought about STEM fields, given I just kind of assumed that astrophysicists were the official People Who Know About Space and therefore rocketry must be part of their domain. I don't know whether I want to ask if you can recommend any good fluid dynamics introductions, or whether I don't want to add to the several feet high pile of books next to my bed...

Okay - so why do you think quantum mechanics became more "cool" than fluid dynamics? Was there a time when fluid dynamics held the equivalent prestige and mystery that quantum mechanics has today? It clearly seems to be more useful, and something that you could easily become curious about just from everyday events like carrying a cup of tea upstairs and pondering how near-impossible it is not to spill a few drops if you've overfilled it.

Comment author: ErikM 21 July 2015 08:39:15PM *  4 points [-]

My intuitions say that specialism increases output, so we should have an all-controlling central state with specialist optimal-career-distributors and specialist psychologist day-planners who hand out schedules and to-do lists to every citizen every day which must be followed to the letter on pain of death and in which the citizens have zero say.

To me, this seems like a happy wonderful place that I would very much like to live in. Unfortunately, everyone else seems to strongly disagree.

I think there's an implicit premise or two that you may have mentally included but failed to express, running along the lines of:

The all-controlling state is run by completely benevolent beings who are devoted to their duty and never make errors.

Sans such a premise, one lazy bureaucrat cribbing his cubicle neighbor's allocations, or a sloppy one switching the numbers on two careers, can cause a hell of a lot of pain by assigning an inappropriate set of tasks for people to do. Zero say and the death penalty for disobedience then makes the pain practically irremediable. A lot of the reason for weak and ineffective government is trying to mitigate and limit government's ability to do terribly terribly wicked things, because governments are often highly skilled at doing terribly terribly wicked things, and in unique positions to do so, and can do so by minor accident. You seem to have ignored the possibility of anything going wrong when following your intuition.

Moreover, there's a second possible implicit premise:

These angels hold exactly and only the values shared by all mankind, and correct knowledge about everything.

Imagine someone with different values or beliefs in charge of that all-controlling state with the death penalty. For instance, I have previously observed that Boko Haram has a sliver of a valid point in their criticism of Western education when noting that it appears to have been a major driver in causing Western fertility rates to drop below replacement and show no sign of recovery. Obviously you can't have a wonderful future full of happy people if humans have gone extinct, therefore the Boko Haram state bans Western education on pain of death. For those already poisoned by it, such as you, you will spend your next ten years remedially bearing and rearing children and you are henceforth forbidden access to any and all reading material beyond instructions on diaper packaging. Boko Haram is confident that this is the optimal career for you and that they're maximizing the integral of human happiness over time, despite how much you may scream in the short term at the idea.

With such premises spelled out, I predict people wouldn't object to your ideal world so much as they'd object to the grossly unrealistic prospect. But without such, you're proposing a totalitarian dictatorship and triggering a hell of a lot of warning signs and heuristics and pattern-matching to slavery, tyranny, the Soviet Union, and various other terrible bad things where one party holds absolute power to tell other people how to live their life.

"But it's a benevolent dictatorship", I imagine you saying. Pull the other one, it has bells on. The neoreactionaries at least have a proposed incentive structure to encourage the dictator to be benevolent in their proposal to bring back monarchy. (TL;DR taxes go into the king's purse giving the king a long planning horizon) What have you got? Remember, you are one in seven billion people, you will almost certainly not be in charge of this all-powerful state if it's ever implemented, and when you do your safety design you should imagine it being in the hands of randoms at the least, and of enemies if you want to display caution.

Comment author: Acty 25 July 2015 02:53:42AM *  -1 points [-]

--

View more: Next