timtyler comments on Thoughts on the Singularity Institute (SI) - Less Wrong

256 Post author: HoldenKarnofsky 11 May 2012 04:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (1270)

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 16 May 2012 12:18:56AM 1 point [-]

Today's ecosystems maximise entropy. Maximising primeness is different, but surely not greatly more interesting - since entropy is widely regarded as being tedious and boring.

Comment author: CuSithBell 16 May 2012 12:25:22AM 0 points [-]

Intriguing! But even granting that, there's a big difference between extrapolating the values of a screwed-up offshoot of an entropy-optimizing process and extrapolating the value of "maximize entropy". Or do you suspect that a FOOMing AI would be much less powerful and more prone to interesting errors than Eliezer believes?

Comment author: Dolores1984 16 May 2012 12:34:11AM 2 points [-]

Truly maximizing entropy would involve burning everything you can burn, tearing the matter of solar systems apart, accelerating stars towards nova, trying to accelerate the evaporation of black holes and prevent their formation, and other things of this sort. It'd look like a dark spot in the sky that'd get bigger at approximately the speed of light.

Comment author: timtyler 16 May 2012 01:25:53AM *  3 points [-]

Fires are crude entropy maximisers. Living systems destroy energy dradients at all scales, resulting in more comprehensive devastation than mere flames can muster.

Of course, maximisation is often subject to constraints. Your complaint is rather like saying that water doesn't "truly minimise" its altitude - since otherwise it would end up at the planet's core. That usage is simply not what the terms "maximise" and "minimise" normally refer to.

Comment author: CuSithBell 16 May 2012 12:42:17AM 0 points [-]

Yeah! Compelling, but not "interesting". Likewise, I expect that actually maximizing the fitness of a species would be similarly "boring".