You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Stuart_Armstrong comments on Embracing the "sadistic" conclusion - Less Wrong Discussion

10 Post author: Stuart_Armstrong 13 February 2014 10:30AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (41)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 13 February 2014 12:13:48PM 6 points [-]

A proper theory of population ethics should be complex, as our population intuitions are complex...

Comment author: NoSuchPlace 13 February 2014 01:30:40PM *  1 point [-]

our population intuitions are complex...

Are they? They certainly look complex, but that could be because we haven't found the proper way to describe them. For example the Mandelbrot set looks complex, but it can be defined in a single line.

Also "complex" leads to ambiguity, perhaps it needs to be defined. I used it in the sense that something is complex if it cannot be quickly defined for a smart and reasonably knowledgeable (in the relevant domain) human, since this seems to be the relevant sense here.

Comment author: Vulture 13 February 2014 07:49:32PM 1 point [-]

There's no particular reason why we should expect highly abstract aspects of our random-walk psychological presets to be elegant or simply defined. As such, it's practically guaranteed that they won't be.

Comment author: NoSuchPlace 13 February 2014 09:37:53PM 0 points [-]

I'm not saying that our population intuitions are simple, I'm saying that we can't rule out the possibility. For example a prior I wouldn't have expected physics to turn out to be simple, however (at least to the level that I took it) physics seems to be remarkably simple (particularly in comparison to the universe it describes), this leads me to conclude that there is some mechanism by which things turn out to be simpler than I would expect.

To give an example, my best guess (besides "something I haven''t though of") for this mechanism is that mathematical expressions are fairly evenly distributed over patterns which occur in reality, and that one should hence expect there to be a fairly simple piece of mathematics which comes very close to describing physics, a similar thing might happen with our population intuitions.

There's no particular reason why we should expect highly abstract aspects of our random-walk psychological presets to be elegant or simply defined.

Wouldn't highly abstract aspects of our psychology be be more recent and as such simpler?

As such, it's practically guaranteed that they won't be.

This depends on your priors. If you assign comparable probabilities to simple and complex hypothesis, this follows. If you assign higher probabilities to simple hypothesis than complex ones it doesn't.

Comment author: Vulture 13 February 2014 11:03:47PM *  0 points [-]

This depends on your priors. If you assign comparable probabilities to simple and complex hypothesis, this follows. If you assign higher probabilities to simple hypothesis than complex ones it doesn't.

If you flip 1000 fair coins, the resulting output is more likely to be a mishmash of meaningless clumps than it is to be something like "HHTTHHTTHHTTHHTT..." or another very simple repeating pattern. Similarly, a chaotic[1] process like the evolution of our ethical intuitions is more likely to produce an arbitrary mishmash of conflicting emotional drives than it is to produce some coherent system which can easily be extrapolated into an elegant theory of population ethics. All of this is perfectly consistent with any reasonable formalization of Occam's Razor.

EDIT: The new definition of "complex" that you added above is a reasonable one in general, but in this case it might lead to some dangerous circularity - it seems okay right now, but defining complexity in terms of human intuition while we're discussing the complexity of human intuition seems like a risky maneuver.

Wouldn't highly abstract aspects of our psychology be be more recent and as such simpler?

The abstract aspects in question are abstractions and extrapolations of much older empathy patterns, or are trying to be. So, no.


  1. In the colloquial sense of "lots and lots and lots of difficult-to-untangle significant contributing factors"
Comment author: Stuart_Armstrong 13 February 2014 02:57:27PM 1 point [-]

Maybe a better phrasing would be that we don't a priori expect them to be simple...