You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Dmytry comments on What are YOU doing against risks from AI? - Less Wrong Discussion

-5 Post author: XiXiDu 17 March 2012 11:56AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (40)

You are viewing a single comment's thread.

Comment author: Dmytry 17 March 2012 12:16:21PM *  0 points [-]

Nothing. The arguments towards any course of action have very low external probabilities (which I assign when I see equally plausible but contradicting arguments), resulting in very low expected utilities even if the bad AI is presumed to do some drastically evil stuff vs good AI doing some drastically nice stuff. There are many problems for which efforts have larger expected payoff.

edit:

I do subscribe to the school of thought that the irregular connectionist AIs (neural networks, brain emulations of various kind and the like) are the ones least likely to engage in highly structured effort like maximization of some scary utility to the destruction of everything else. I'm very dubious that the agent can have foresight so good as to decide humans are not worth preserving, as part of general "gather more interesting information" heuristics.

While the design space near the FAI is a minefield of monster AIs and a bugged FAI represents a worst case scenario. There is a draft of my article on the topic. Note: I am a software developer, and I am very sceptical about our ability to write FAI that is not bugged, as well as of ability to detect substantial problems in FAI goal system, as regardless of the goal system the FAI will do all it can to pretend to be working correctly.

Comment author: Alex_Altair 17 March 2012 12:33:34PM 1 point [-]

There is a draft of my article on the topic.

I can't see this draft. I think only those who write them can see drafts.

Comment author: Dmytry 17 March 2012 12:35:44PM 0 points [-]

Hmm, weird. I thought the hide button would hide it from public, and un-hide button would unhide. How do i make it public as a draft?

Comment author: Multiheaded 17 March 2012 02:33:54PM 0 points [-]

Just post it to Discussion and immediately use "Delete". It'll still be readable and linkable, but not seen in the index.

Comment author: Dmytry 17 March 2012 03:04:06PM *  0 points [-]

Hmm, can you see it now? (I of course kept a copy of the text on my computer, in case you were joking, so i do have the draft reposted as well)

Comment author: Rain 17 March 2012 04:51:11PM 0 points [-]

It is now readable at the previous link, yes.