WrongBot comments on Just One Sentence - Less Wrong

33 Post author: Eliezer_Yudkowsky 05 January 2013 01:27AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (141)

You are viewing a single comment's thread.

Comment author: WrongBot 05 January 2013 02:11:56AM 36 points [-]

"If you perform experiments to determine the physical laws of our universe, you will learn how to make powerful weapons."

It's all about incentives.

Comment author: [deleted] 05 January 2013 02:37:36AM *  15 points [-]

"physical laws" and "universe" maybe suppose too much background.

I cross-pollinate your thing with EY's:

"If you test theories by how precisely they predict experimental results, you will learn how to make powerful weapons."

EDIT: My latest version is "If you test theories by how precisely they predict experimental results, you will unlock the secrets of the ancients." Which fixes a few bugs.

Comment author: AdeleneDawner 05 January 2013 04:12:50AM 11 points [-]

That parses as 'do not let others conduct experiments'. Probably not what you're aiming for.

Comment author: magfrump 05 January 2013 06:35:20PM 6 points [-]

"If everyone tests theories by how precisely they predict experimental results, the secrets of the ancients will be unlocked."

Comment author: [deleted] 05 January 2013 04:18:19AM 6 points [-]

Ooops.

Comment author: abramdemski 06 January 2013 07:18:32AM 2 points [-]

"If everyone tests theories by how precisely they predict experimental results, you will learn to cure illnesses and solve many other problems."

Comment author: Yossarian 03 April 2013 05:58:55PM 3 points [-]

"If you test theories by how precisely they predict experimental results, you will have many more opportunities to have sex and look cool."

Comment author: [deleted] 04 April 2013 01:48:17AM 0 points [-]

i find this unconvincing. i think i might just go wallow in the muck instead.

Comment author: James_Miller 05 January 2013 05:36:17AM *  9 points [-]

If you get into the practice of keeping honest and accurate records of everything, and quantifying as much as you can, then you will become much better at military logistics.

Comment author: Xachariah 05 January 2013 04:49:33AM *  6 points [-]

If you just want incentives then I'd go with - "In 500 years, a gamma ray burst will wipe out all humanity unless you colonize distant stars, so get to work."

Afterall, 'powerful weapons' presumably caused the problem in the first place. A burning, racially/religious/culturally rooted drive to reach the stars would be far more useful in the long run than a desire to conquer our enemies, even if it is based on a lie.

Comment author: [deleted] 05 January 2013 04:53:42AM 5 points [-]

How would their perception of that claim differ from our perception of the mayans' claim about 12/21/12?

Comment author: Xachariah 05 January 2013 05:00:46AM 2 points [-]

It would be no different than how "germs cause diseases" would be dismissed as not trusting in evil spirits, or the atomic hypothesis being the rantings of a madman. Presumably anything we tell them they'll have to take on faith until they can check for themselves.

And by the time they're putting up orbital telescopes to look for possible gamma ray burst candidates, I think humanity will be in a safe enough position.

Comment author: Bill_McGrath 07 January 2013 10:44:56AM -1 points [-]

There would BE a claim, for starters... Excellent point though, you'd need some additional evidence or stagecraft to impress them, which probably counts as increasing the size of the message.

Comment author: OrphanWilde 05 January 2013 02:30:09AM 0 points [-]

Do you think wisdom automatically follows knowledge, however?

Comment author: [deleted] 05 January 2013 02:57:28AM 1 point [-]

I think we can take it as given that even with the nukes, science has been a win. Then again, we are talking about a post-apocalyptic future....

Comment author: OrphanWilde 05 January 2013 02:58:52AM 5 points [-]

Science has been a win in cultures in which knowledge hasn't exclusively been pursued for the purposes of killing people. It's not merely that it's a post-apocalyptic future, it's a problem that there has historically been a self-selection process about who pursued knowledge, which is getting subverted here.

Comment author: [deleted] 05 January 2013 03:12:40AM 4 points [-]

That's a good point. Maybe we can come up with a better incentive.

"If you do X, you will unlock the secrets of the ancients."

Comment author: TimS 05 January 2013 03:52:59AM 3 points [-]

We need some historical cites, because I don't know what you are talking about.

Comment author: OrphanWilde 05 January 2013 04:23:01AM 3 points [-]

For the obvious example, many of the best scientists working on the Manhattan Project only agreed because they were worried about Germany getting nuclear weapons first and what it would mean; likewise, scientists in Germany were deliberately sabotaging their own research.

There's a safety feature here that this quote, to the extent that it is effective at all, deliberately attempts to remove.

Comment author: TimS 05 January 2013 04:39:48AM 0 points [-]

scientists in Germany were deliberately sabotaging their own research

Brief research suggests this might not be true.

I'm unconvinced that scientific progress is an existential risk, and the increased wealth scientific progress has created has funded or inspired most social progress.

Comment author: OrphanWilde 05 January 2013 05:03:37AM 2 points [-]

Scientific progress for the explicit and deliberate purpose of killing people more efficiently is a different animal than scientific progress more generally. You're engaging in an association fallacy, specifically honor by association (although that fallacy is more often used to refer to individuals or organizations rather than abstract concepts).

Comment author: TimS 05 January 2013 05:38:08AM 2 points [-]

Yes, that is the essence of our disagreement. You think I'm committing an association fallacy, and I think you are artificially dividing science in ways that don't reflect actual historic scientific practice.

Comment author: [deleted] 05 January 2013 04:10:33AM 0 points [-]

In aggregate, over time? Probably.

Comment author: OrphanWilde 05 January 2013 04:23:39AM 0 points [-]

For what reason do you believe this?

Comment author: [deleted] 05 January 2013 05:06:03AM *  1 point [-]

I believe it because where do you see human affairs comprised of strictly one and not the other?

It isn't 1 to 1. Maybe there isn't any guaranteed ratio. But I think with enough knowledge and enough people, eventually wisdom grows (like mold -- patchy at first, but spreading given the right conditions).

Or the reverse, "wisdom" turns into knowledge, which turns into wisdom (no scare quotes = good examples of tool use).

Comment author: OrphanWilde 05 January 2013 05:12:15AM 0 points [-]

Strictly one? Or overwhelmingly one?

Wisdom seems rare in all cases; knowledge, however, is common.

Comment author: [deleted] 05 January 2013 05:14:35AM 0 points [-]

If you're talking about the surge in pure knowledge, then yeah, the ratio is changing. But I don't think most people notice beyond a dim awareness of "my iPhone is magic, I wonder what makes it go."