Trevor_Blake comments on [SEQ RERUN] A Few Background Posts by Robin Hanson - Less Wrong

3 Post author: MinibearRex 06 November 2012 05:10AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (7)

You are viewing a single comment's thread.

Comment author: [deleted] 06 November 2012 10:12:49AM 2 points [-]

From "Friendly Teams" ...

Small teams have at times suddenly acquired disproportionate power, and I’m sure their associates who anticipated this possibility used the usual human ways to consider that team’s “friendliness.”  But I can’t recall a time when such sudden small team power came from an UberTool scenario of rapidly mutually improving tools.

In August 1945 an ubertool was demonstrated two times in Japan.

Comment author: Tyrrell_McAllister 06 November 2012 10:00:02PM 5 points [-]

But the United States was not a "small team".

Comment author: moridinamael 06 November 2012 08:47:37PM 4 points [-]

Relatedly, there have been numerous instances of individual humans taking over entire national governments by exploiting high-leverage, usually unethical, opportunities. A typical case involves a military general staging a coup or an elected leader legislating unlimited power unto himself. None of these instances look anything like firms competing for resources. Instead, we have single actors who are intelligent and opportunistic, unethical or morally atypicall, and risk-tolerant enough to accept the consequences of a failed coup.

A UFAI looks much more like a dictator than a firm.

Comment author: Eugine_Nier 07 November 2012 05:57:22AM 0 points [-]

All those require the an least implicit cooperation of a lot of other people, e.g., the general's army.