Drahflow comments on Fusing AI with Superstition - Less Wrong

-6 Post author: Drahflow 21 April 2010 11:04AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (75)

You are viewing a single comment's thread. Show more comments above.

Comment author: Drahflow 21 April 2010 09:02:32PM 0 points [-]

I agree. The AI + Fuse System is a deliberately broken AI. In general such an AI will perform suboptimal compared to the AI alone.

If the AI under consideration has a problematic goal though, we actually want the AI to act suboptimal with regards to its goals.

Comment author: JamesAndrix 22 April 2010 01:36:38AM 2 points [-]

I think it's broken worse than that. A false belief with certainty will allow for something like the explosion principle.

http://en.wikipedia.org/wiki/Principle_of_explosion

As implications of magic collide with observations indicating an ordinary wire, the AI may infer things that are insanely skewed. Where in the belief network these collisions happen could depend on the particulars of the algorithm involved and the shape of the belief network, it would probably be very unpredictable.