Anything that cannot "reshape entire planets in a matter of minutes, rewrite everyone's DNA, travel faster than light, rewrite the laws of physics, etc" cannot possibly be intelligent enough to qualify as a threat? That seems an odd statement, given that some of those are thought to be impossible.
No. That isn't implied by what I said.
The relevant sentence is "In light of this, I believe that worrying about the friendliness of AI is kind of a waste of time". If that to which the label 'singularity' is applied is not sufficiently powerful for worrying about friendliness then the label is most certainly applied incorrectly.
As I'd already mentioned, I am far from convinced that a sufficiently powerful AI will emerge any time soon. Furthermore, I believe that such an AI will still be constrained by the laws of physics, regardless of how smart it is, which will put severe limits on its power. I also believe that our current understanding of the laws of physics is more or less accurate; i.e., the AI won't suddenly discover how to make energy from nothing or how to travel faster than light, regardless of how much CPU power it spends on the task. So far so good; but I am also far ...
What do you believe that most people on this site don't?
I'm especially looking for things that you wouldn't even mention if someone wasn't explicitly asking for them. Stuff you're not even comfortable writing under your own name. Making a one-shot account here is very easy, go ahead and do that if you don't want to tarnish your image.
I think a big problem with a "community" dedicated to being less wrong is that it will make people more concerned about APPEARING less wrong. The biggest part of my intellectual journey so far has been the acquisition of new and startling knowledge, and that knowledge doesn't seem likely to turn up here in the conditions that currently exist.
So please, tell me the crazy things you're otherwise afraid to say. I want to know them, because they might be true.