= 27d567bc2d48d9f40e9ccc20ea370b15)
whpearson comments on Let's reimplement EURISKO! - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (151)
rwallace has been arguing the position that AI researchers are too concerned (or will become too concerned) about the existential risk from UFAI. He writes that
rwallace: can we deal with complexity sufficiently well without new software that engages in strongly-recursive self-improvement?
Without new AGI software?
One part of the risk that rwallace says outweighs the risk of UFAI is that
The only response rwallace suggests to that risk is
rwallace: please give your reasoning for how more advanced technology decreases the existential risk posed by weapons more than it increases it.
Another part of the risk that rwallace says outweighs the risk of UFAI is that
Please explain how dwindling resources presents a significant existential risk. I can come up with several argument, but I'd like to see the one or two you consider the strongest arguments.
If we have uploads we can get off the planet and stay in space for a fraction of the resources it currently costs to do manned space flight. We can spread ourselves between the stars.
But an upload might go foom, so we should stop all upload research.
It is this kind of conundrum I see humanity in at the moment.
I agree, and will add:
First, an upload isn't going to "go foom": a digital substrate doesn't magically confer superpowers, and early uploads will likely be less powerful than their biological counterparts in several ways.
Second, stopping upload research is not the path of safety, because ultimately we must advance or die.
You can't copy paste hardware; and no, an upload won't be able to run on a botnet.
Not to mention the bizarre assumption that an uploading patient will turn into a comic book villain whose sole purpose is to conquer the world.
Source?
Upvoted for this.
You know, I don't think I've ever seen someone argue that. Does anyone have any links?