You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

jacob_cannell comments on Could you tell me what's wrong with this? - Less Wrong Discussion

1 Post author: Algon 14 April 2015 10:43AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (64)

You are viewing a single comment's thread. Show more comments above.

Comment author: jacob_cannell 16 April 2015 06:37:46AM 0 points [-]

Alright, what I got from your post is that if you know the definition of an FAI and can instruct a computer to design one, you've basically already made one.

Yes. Although to be clear, the most likely path probably involves a very indirect form of specification based on learning from humans.

Comment author: Algon 16 April 2015 07:16:40AM 0 points [-]

Ok. So why could you not replace 'encode an FAI' with 'define an FAI?' And you would place all the restrictions I detailed on that AI. Or is there still a problem?