Highly recommend kazerad, for Scott-level insights about human behavior. Here's his analysis of 4chan's anonymous culture. Here's another insightful essay of his. And a post on memetics. And these aren't necessarily the best posts I've read by him, just the three I happened to find first.
By the way, I'm really averse to the label "hidden rationalists". It's like complimenting people by saying "secretly a member of our ingroup, but just doesn't know it yet". Which simultaneously presupposes the person would want to be a member of o...
Here are the ten I thought of:
Also I totally second whoever said "nice kitchen knives"....
This post demonstrates a common failure of LessWrong thinking, where it is assumed that there is one right answer to something, when in fact this might not be the case. There may be many "right ways" for a single person to think about how much to give to charity. There may be different "right ways" for different people, especially if those people have different utility functions.
I think you probably know this, I am just picking on the wording, because I think that this wording nudges us towards thinking about these kinds of questions in an unhelpful way.
But it asks about “the right way to think about how much to give to charity”, not “the right amount to give to charity”. It is well possible (depending on what one means by “way to think about”) that there is one right way to think about how much to give to charity but it returns different outputs given different inputs.
Thanks for this post! I also spend far too much time worrying about inconsequential decisions, and it wouldn't surprise me if this is a common problem on LessWrong. In some sense, I think that rationality actually puts us at risk for this kind of decision anxiety, because rationality teaches us to look at every situation and ask, "Why am I doing it this way? Is there a different way I could do it that would be better?" By focusing on improving our lives, we end up overthinking our decisions. And we tend to frame these things as optimization ...
I think it's worth including inference on the list of things that make machine learning difficult. The more complicated your model is, the more computationally difficult it will be to do inference in it, meaning that researchers often have to limit themselves to a much simpler model than they'd actually prefer to use, in order to make inference actually tractable.
Analogies are pervasive in thought. I was under the impression that cognitive scientists basically agree that a large portion of our thought is analogical, and that we would be completely lost without our capacity for analogy? But perhaps I've only been exposed to a narrow subsection of cognitive science, and there are many other cognitive scientists who disagree? Dunno.
But anyway I find it useful to think of analogy in terms of hierarchical modeling. Suppose you have a bunch of categories, but you don't see any relation between them. So maybe you kno...
I'm also reading this book, and I'm actually finding it profoundly unimpressive. Basically it's a 500-page collection of examples, with very little theoretical content. The worst thing, though, is that its hypothesis seems to fundamentally undermine itself. Hofstadter and Sander claim that concepts and analogy are the same phenomenon. But they also say that concepts are very flexible, non-rigid things, and that we expand and contract their boundaries whenever it's convenient for reasoning, and that we do this by making analogies between the original co...
Oh hey, this is convenient, I just got to Sydney yesterday and you guys have a meetup tonight. =) I'll probably attend. (I'm in town for three months, visiting from the United States.)
I have an ulterior motive for attending: I am looking for housing near Macquarie University for the next three months. I don't suppose anyone here has a room for rent, or knows of a good place to stay? (Sorry if this is the wrong place to ask about such things!)
Sure, but that understanding is very specific to our culture. It's only recently that we've come to see procreation as "recreation" - something unnecessary that we do for personal fulfillment.
Many people don't hold jobs just to avoid being poor. It's also a duty to society. If you can't support yourself, then you're a burden on society and its infrastructure.
Similarly, having children was once thought of as a duty to society. I read an article about this recently: http://www.artofmanliness.com/2014/03/03/the-3-ps-of-manhood-procreate/
Anyway, ...
To construct a friendly AI, you need to be able to make vague concepts crystal clear, cutting reality at the joints when those joints are obscure and fractal - and them implement a system that implements that cut.
Strongly disagree. The whole point of Bayesian reasoning is that it allows us to deal with uncertainty. And one huge source of uncertainty is that we don't have precise understandings of the concepts we use. When we first learn a new concept, we have a ton of uncertainty about its location in thingspace. As we collect more data (either thro...
I can't help but think that some of this has to do with feminism, at least in the case of girl teenagers. I hear a lot of people emphasizing that having children is a choice, and it's not for everyone. People are constantly saying things like "Having children is a huge responsibility and you have to think very carefully whether you want to do it." The people saying this seem to have a sense that they're counterbalancing societal pressures that say everyone should have children, or that women should focus on raising kids instead of having a car...
Cog sci question about how words are organized in our minds.
So, I'm a native English speaker, and for the last ~1.5 years, I've been studying Finnish as a second language. I was making very slow progress on vocabulary, though, so a couple days ago I downloaded Anki and moved all my vocab lists over to there. These vocab lists basically just contained random words I had encountered on the internet and felt like writing down; a lot of them were for abstract concepts and random things that probably won't come up in conversation, like "archipelago"...
These are interesting questions. I think the keyword you want for "hash collisions" is interference. Here's a more helpful overview from an education perspective: Learning Vocabulary in Lexical Sets: Dangers and Guidelines (2000). It mostly talks about semantic interference, but it mentions some other work on similar-sounding and similar-looking words.
Hmm. If you want to know how Bayesian models of cognition work, this paper might be a good place to start, but I haven't read it yet: "Bayesian Models of Cognition", by Griffiths, Kemp, and Tenenbaum.
I'm taking a philosophy class right now on Bayesian models of cognition, and we've read a few papers critiquing Bayesian approaches: "Bayesian Fundamentalism or Enlightenment?", by Jones and Love "Bayesian Just-So Stories in Psychology and Neuroscience", by Bowers and Davis Iirc, it's the latter that discusses the unfalsifiabilit...
It might be worth noting that Bayesian models of cognition have played a big role in the "rationality wars" lately. The idea is that if humans are basically rational, their behaviors will resemble the output of a Bayesian model. Since human behavior really does match the behavior of a Bayesian model in a lot of cases, people argue that humans really are rational. (There has been plenty of criticism of this approach, for instance that there are so many different Bayesian models in the world that one is sure to match the data, and thus the whole...
This description/advice is awesome, and I mostly agree, but I think it presents an overly uniform impression of what love is like. I've been in Mature Adult Love multiple times, and the feelings involved have been different every time. I wouldn't necessarily reject your division into obsession, closeness, and sexual desire, but I think maybe there are different kinds (or components) of closeness, such as affection, understanding, appreciation, loyalty, etc., and any friendship or relationship will have these in differing degrees. For instance, for a lot of people, family love seems to involve a lot of loyalty but not as much understanding.
Hmm, I can see arguments for and against calling computationalism a form of dualism. I don't think it matters much, so I'll accept your claim that it's not.
As for embodied cognition, most of what I know about it comes from reading Lawrence Shapiro's book Embodied Cognition. I was much less impressed with the field after reading that book, but I do think the general idea is important, that it's a mistake to think of the mind and body as separate things, and that in order to study cognition we have to take the body into consideration.
I agree that embodimen...
Ah. I'm not sure I agree with you on the nature of the self. What evidence do you have that your mind could be instantiated in a different medium and still lead to the same subjective experience? (Or is subjective experience irrelevant to your definition of self?)
I mean, I don't necessarily disagree with this kind of dualism; it seems possible, even given what I know about embodied cognition. I just am not sure how it could be tested scientifically.
Hmm, I'll have to look into the predictive power thing, and the tradeoff between predictive power and efficiency. I figured viewing society as an organism would drastically improve computational efficiency over trying to reason about and then aggregate individual people's preferences, so that any drop in predictive power might be worth it. But I'm not sure I've seen evidence in either direction; I just assumed it based on analogy and priors.
As for why you should care, I don't think you should, necessarily, if you don't already. But I think for a lot of people, serving some kind of emergent structure or higher ideal is an important source of existential fulfillment.
Thanks for this post. I basically agree with you, and it's very nice to see this here, given how one-sided LW's discussion on death usually is.
I agree with you that the death of individual humans is important for the societal suporganism because it keeps us from stagnating. But even if that weren't true, I would still strongly believe in the value of accepting death, for pretty much exactly the reasons you mentioned. Like you, I also suspect that modern society's sheltering, both of children and adults, is leading to our obsession with preventing death ...
What would it mean to examine this issue dispassionately? From a utilitarian perspective, it seems like choosing between deathism and anti-deathism is a matter of computing the utility of each, and then choosing the one with the higher utility. I assume that a substantial portion of the negative utility surrounding death comes from the pain it causes to close family members and friends. Without having experienced such a thing oneself, it seems difficult to estimate exactly how much negative utility death brings.
(That said, I also strongly suspect that cultural views on death play a big role in determining how much negative utility there will be.)
I wish I could upvote this comment more than once. This is something I've struggled with a lot over the past few months: I know that my opinions/decisions/feelings are probably influenced by these physiological/psychological things more than by my beliefs/worldview/rational arguments, and the best way to gain mental stability would be to do more yoga (since in my experience, this always works). Yet I've had trouble shaking my attachment to philosophical justifications. There's something rather terrifying about methods (yoga, narrative, etc.) that work o...
Particularly frightening to me has been the idea that doing yoga or meditation might change my goals, especially since the teachers of these techniques always seem to wrap the techniques in some worldview or other that I may dislike.
Yesterday I was in a church, for a friend's wedding. I was listening to some readings from the Bible, about love (obviously 1 Cor 13) etc. I knew this was cherry-picking from a book that a few hundred pages sooner also describes how non-believers or people who violate some rule should be murdered. But still, the message was ...
I was wondering this too. I haven't looked at this A_p distribution yet (nor have I read all the comments here), but having distributions over distributions is, like, the core of Bayesian methods in machine learning. You don't just keep a single estimate of the probability; you keep a distribution over possible probabilities, exactly like David is saying. I don't even know how updating your probability distribution in light of new evidence (aka a "Bayesian update") would work without this.
Am I missing something about David's post? I did go through it rather quickly.
Forgive me, but the premise of this post seems unbelievably arrogant. You are interested in communicating with "intellectual elites"; these people have their own communities and channels of communication. Instead of asking what those channels are and how you can become part of them, you instead ask how you can lure those people away from their communities, so that they'll devote their limited free time to posting on LW instead.
I'm in academia (not an "intellectual elite", just a lowly grad student), and I've often felt torn between my...
Who are some of the best writers in the history of civilization?
Different writers have such different styles that I'm not sure it's possible to measure them all on a simple linear scale from "bad writing" to "good writing". (Or rather, of course it's possible, but I think it reduces the dimensionality so much that the answer is no longer useful.)
If I were to construct such a linear scale, I might do so by asking "How well does this writer's style serve his goals?" Or maybe "How well does this writer's style match his...
I cannot agree with this more strongly. I was burnt out for a year, and I've only just begun to recover over the last month or two. But one thing that speeded my recovery greatly over the last few weeks was stopping worrying about burnout. Every time I sat down to work, I would gauge my wanting-to-work-ness. When I inevitably found it lacking, I would go off on a thought spiral asking "why don't I like working? how can I make myself like working?" which of course distracted me from doing the actual work. Also, the constant worry about my bur...
There are also things which are bad to learn for epistemic rationality reasons.
Sampling bias is an obvious case of this. Suppose you want to learn about the demographics of city X. Maybe half of the Xians have black hair, and the other half have blue hair. If you are introduced to 5 blue-haired Xians but no black-haired Xians, you might infer that all or most Xians have blue hair. That is a pretty obvious case of sampling bias. I guess what I'm trying to get at is that learning a few true facts (Xian1 has blue hair, Xian2 has blue hair, ... , Xian5 ha...
This kind of AI might not cause the same kinds of existential risk typically described on this website, but I certainly wouldn't call it "safe". These technologies have a huge potential to reshape our lives. In particular, they can have a huge influence on our perceptions.
All of our search results come filtered through google's algorithm, which, when tailored to the individual user, creates a filter bubble. This changes our perception of what's on the web, and we're scarcely even conscious that the filter bubble exists. If you don't know abou...
Hmm, you're probably right. I guess I was thinking that quick heuristics (vocabulary choice, spelling ability, etc.) form a prior when you are evaluating the actual quality of the argument based on its contents, but evidence might be a better word.
Where is the line drawn between evidence and prior? If I'm evaluating a person's argument, and I know that he's made bad arguments in the past, is that knowledge prior or evidence?
Unless the jargon perpetuates a false dichotomy, or otherwise obscures relevant content. In politics, those who think in terms of a black-and-white distinction between liberal and conservative may have a hard time understanding positions that fall in the middle (or defy the spectrum altogether). Or, on LessWrong, people often employ social-status-based explanations. We all have the jargon for that, so it's easy to think about and communicate, but focusing on status-motivations obscures people's other motivations.
(I was going to explain this in terms of dimensionality reduction, but then I thought better of using potentially-obscure machine learning jargon. =) )
I agree with you that it's useful to optimize communication strategies for your audience. However, I don't think that always results in using shared jargon. Deliberately avoiding jargon can presumably provide new perspectives, or clarify issues and definitions in much the way that a rationalist taboo would.
This is very related to something my friend pointed out a couple weeks ago. Jargon doesn't just make us less able to communicate with people from outside groups - it makes us less willing to communicate with them.
As truth-seeking rationalists, we should be interested in communicating with people who make good arguments, consider points carefully, etc. But I think we often judge someone's rationality based on jargon instead of the content of their message. If someone uses a lot of LessWrong jargon, it gives a prior that they are rational, which may bia...
I think it's a grave mistake to equate self-esteem with social status. Self-esteem is an internal judgment of self-worth; social status is an external judgment of self-worth. By conflating the two, you surrender all control of your own self-worth to the vagaries of the slavering crowd.
Someone can have high self-esteem without high social status, and vice versa. In fact, I might expect someone with a strong internal sense of self-worth to be less interested in seeking high social status markers (like a fancy car, important career, etc.). When I say &quo...
Regarding PUA jargon...
I'm female and submissive and I've always been attracted to guys about eight years older than me. (When I say "always", I mean since my first serious crush at age 13.) My parents are feminists, they're the same age as each other, and they strongly believe in power equality in relationships. Thus, growing up, I always thought there was something terribly wrong with me.
In college, I learned about PUA and alpha males an all of that. Suddenly, here was an ideological system that treated my desires as natural instead of pe...
From what I could tell, feminism was just another optimistic belief system built on a very common but very rotten foundation: the idea that humans are rational creatures, that our rationality elevates us high above our brutal and bestial forebears.
I believe that at least a large part of feminism was created by women who were unhappy in an environment which didn't suit their personalities and/or made it very easy for men to abuse women.
Suddenly, here was an ideological system that treated my desires as natural instead of perverted.
Revolutions generally come with from an impulse to throw off imposed ideals, but usually end up imposing new ideals. The king is dead. Long live the king.
The desire for freedom is freedom from a constraint, and doesn't allow the naturally coalition building and power accretion of those who would impose constraints.
...I'm not really sure why I'm telling this story.
My guess - you saw the value to yourself of seeing your views not being portrayed as perverted, and took the opportunity to give the same kind of support to others who might feel that way.
I am female, and (to a large extent) my experience agrees with Submitter E's. I'm glad to see this posted here, because after reading the other LW and Women posts, I had begun to suspect that I was a complete outlier, and that I couldn't use my own experiences as a reference point for other women's at all.
This relates to something I've been concerned about in regards to social justice discussions-- the discussions actively discourage people from saying that they aren't being hurt even though they're in a group which (probably) gets hurt more than the other group on the same axis.
While I can see discouraging people from saying "I'm not getting hurt, therefore getting hurt almost never happens/doesn't matter", leaving out single data points about not getting hurt leads to another version of not knowing what's going on.
You may be interested in the literature on "concept learning", a topic in computational cognitive science. Researchers in this field have sought to formalize the notion of a concept, and to develop methods for learning these concepts from data. (The concepts learned will depend on which specific data the agent encounters, and so this captures the some of the subjectivity you are looking for.)
In this literature, concepts are usually treated as probability distributions over objects in the world. If you google "concept learning" you should find some stuff.
This is one of the big reasons that niceness annoys me. I think I've developed a knee-jerk negative reaction to comments like "good job!" because I don't want to be manipulated by them. Even when the speaker is just trying to express gratitude, and has no knowledge of behaviorism, "good job!" annoys me. I think it's an issue of one-place vs. two-place predicates - I have no problem with people saying "I like that" or "I find that interesting".
If I let my emotional system process both statements without filtering, ...
Hmm, so I'm thinking about smileys and exclamation points now. I don't think they just demonstrate friendliness - I think they also connote femininity. I used to use them all the time on IRC, until I realized that the only people who did so were female, or were guys who struck me as more feminine as a result. I didn't want to be conspicuously feminine on IRC, so I stopped using smileys/exclamation points there.
It never bothered me when other people didn't use smileys/exclamations. But when I stopped using them on IRC, everything I wrote sounded cold or...
Do other people associate smileys and exclamations with femininity, or is it just me?
Apparently! I started talking to someone about this and he just told me this exact thing independently of you. He said men can only use smileys with women because it's flirting. (??) Which is weird to me because I've met men who are WAY more animated than I am in meatspace. Do they also not use exclamation marks? I don't think I'd be able chat with them online if they didn't; my brain would explode.
But actually, I think this whole issue comes up because we subconsciousl...
Hmm, I definitely see where you're coming from, and I don't (usually) want my comments to hurt anyone. If my comments were consistently upsetting people when I was just trying to have a normal conversation, then I would want to know about this and fix it - both because I actually do care about people's feelings, and because I don't want to prevent every single interesting person from conversing with me. It would take a lot of work, and it would go against my default conversational style, but it would be worth it in the long run.
However, it sounds more li...
Personally, I find the niceness-padding to be perfectly well-calibrated for dealing with disagreements because people are thoughtful and respectful. I find it to be insufficient when dealing with people talking past each other. It's really frustrating! This is a community full of interesting, intelligent people whose opinion I want to know ... that sometimes aren't bothering to carefully read what I wrote. And then not bothering to read carefully when I politely tell them that they misread what I wrote and clarify. So then I start thinking that this isn't ...
I agree with your second paragraph completely, and I would be averse to comments whose only content was "niceness". I'm on LW for intellectual discussions, not for feel-goodism and self-esteem boosts.
I think it's worth distinguishing niceness from respect here. I define niceness to be actions done with the intention of making someone feel good about him/herself. Respect, on the other hand, is an appreciation for another person's viewpoint and intelligence. Respect is saying "We disagree on topic X, but I acknowledge that you are intellig...
Your comment has me wondering whether some folks expect niceness and respect to correlate. I've noticed some social contexts where fake niceness seems to be expected to cloak lack of respect. I wouldn't be surprised if some people around here are embittered from experiences with that.
...It sounds like part of what Submitter B is complaining about is lack of respect. The guys she dated didn't respect her intellect enough to believe assertions she made about her internal experiences. I suspect this is a dearth of respect that no quantity of friendliness can r
I suspect you're aware of this already, but you are basically describing E-Prime.