timtyler comments on Muehlhauser-Wang Dialogue - Less Wrong

24 Post author: lukeprog 22 April 2012 10:40PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (284)

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 23 April 2012 11:17:27PM *  -1 points [-]

Well, nobody is starting out with a superintelligence. We are starting out with sub-human intelligence. A superhuman intelligence is bound to evolve gradually.

No matter what, the first real test flight will be full of passengers.

It didn't work that way with 747s. They did loads of testing before risking hundreds of lives.

Comment author: dlthomas 23 April 2012 11:45:06PM *  0 points [-]

No matter what, the first real test flight will be full of passengers.

It didn't work that way with 747s. They did loads of testing before risking hundreds of lives.

747s aren't smart enough to behave differently when they do or don't have passengers. If the AI might be behaving differently when it's boxed then unboxed, then any boxed test isn't "real"; unboxed tests "have passengers".

Comment author: timtyler 24 April 2012 12:18:29AM *  1 point [-]

Sure, but that's no reason not to test. It's a reason to try and make the tests realistic.

Comment author: dlthomas 24 April 2012 08:50:39PM 1 point [-]

The point is not that we shouldn't test. The point is that tests alone don't give us the assurances we need.