You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Armok_GoB comments on For FAI: Is "Molecular Nanotechnology" putting our best foot forward? - Less Wrong Discussion

48 Post author: leplen 22 June 2013 04:44AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (117)

You are viewing a single comment's thread. Show more comments above.

Comment author: Armok_GoB 28 June 2013 12:14:38AM 1 point [-]

You are confusing probability with difficulty; I'm pretty certain that in some sense, random read-write patterns will eventually cause it to happen with some inconceivably low probability. The question is what'd be required to find the right pattern. Will quantum mechanics put a stop to it before it propagates more than a few atoms? Is there a pattern that'd do it, but finding that pattern would break thermodynamics? Is there a pattern that could be found, but that'd require far more computing power than could ever be built in this universe utilized maximally? Maybe it's technically within reach but would require a matrochika brain. Or maybe, just maybe, almost certainly not, the kind of supercomputer the AI might get it's hands on will be able to do it.

But yea, the probability this particular strategy would be practical is extremely small. That was not my point. my point is that the rough reference class of absurdly overpowered implausibilities, when you integrate over all the myriad different things in it, ends up with a decent chunk of probability put together.

Comment author: Baughn 28 June 2013 04:54:56PM *  4 points [-]

The 'femtotech from HDD' thing is essentially shorthand for some kind of black swan. Considering how powerful mere human-level intelligence is, superintelligence seems certain to find something overpowered somewhere, even if it's just hacking human minds.

FWIW, while my estimate of femtotech-through-weird-bit-patterns is effectively zero, my estimate of femtotech through rewriting the disk firmware and getting it to construct magnetic fields in no way corresponding to normal disk usage is.. well, still near-zero, but several orders of magnitude higher.

If you didn't consider overwriting the firmware as an immediately obvious option, you may be merely human. An AI certainly would, and other options I wouldn't think of. :-)

Comment author: Armok_GoB 28 June 2013 06:31:47PM 1 point [-]

Once again, someone else express my thoughts way better than I ever could.