JamesAndrix comments on Open Thread: February 2010 - Less Wrong

1 Post author: wedrifid 01 February 2010 06:09AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (738)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nick_Tarleton 03 February 2010 02:26:27AM *  1 point [-]

If we give a 1 time 32 bit output register then well, we probably could have brute forced it in the first place.

P ?= NP is one bit. Good luck brute-forcing that.

And you're swearing to yourself that you won't monitor it's execution? Really? How do you even debug that?

FAI is harder.

Comment author: JamesAndrix 03 February 2010 06:39:23AM 0 points [-]

FAI is harder.

No it's not. Look at two simpler cases:

Write a chess program that provably makes only legal moves, iterate as desired to improve it. Or,

Write a chess program. Put it in a sandbox so you only ever see it's moves. Maybe they're all legal, or maybe they're not because you're having it learn the rules with a big neural net or something. At the end of the round of games, the sandbox clears all the memory that held the chess program except for a list of moves in many games. You keep the source. Anything it learned is gone. Iterate as desired to improve it.

If you're confident you could work out how it was thinking from the source and move list, what if you only got a sequence of wins and non-wins? (An array of bits)

Comment author: arbimote 03 February 2010 07:08:27AM 0 points [-]

A sequence of wins and non-wins is enough to tell you whether a given approach can result in intelligent behaviour. That alone is enough to make it a useful experiment.