V_V comments on How to Study Unsafe AGI's safely (and why we might have no choice) - Less Wrong

10 Post author: Punoxysm 07 March 2014 07:24AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (47)

You are viewing a single comment's thread. Show more comments above.

Comment author: V_V 13 March 2014 02:04:00PM 0 points [-]

They were ruled out (with some probability of error) theoretically once people already had working designs, and using knowledge obtained from experimentation on smaller designs.

Nobody here is suggesting to wire the first experimental AGI to the nuclear missiles launch systems. The point is that you need a good idea about what a working AGI design will look like before you can say anything meaningful about its safety.
Experimentation, with reasonable safety measures, will be most likely needed before a full-fledged design can be produced.

Comment author: Squark 13 March 2014 08:28:21PM 0 points [-]

It appears to me that before you start any given experiment you must have sufficient theoretical backing that this particular experiment is safe.