Lumifer comments on AlphaGo versus Lee Sedol - Less Wrong

17 Post author: gjm 09 March 2016 12:22PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (183)

You are viewing a single comment's thread. Show more comments above.

Comment author: Lumifer 22 March 2016 12:07:42AM -1 points [-]

So? An opaque neural net would quickly learn how to get around trade size restrictions if given the proper motivations.

At which point the humans running this NN will notice that it likes to go around risk control measures and will... persuade it that it's a bad idea.

It's not like no one is looking at the trades it's doing.

Comment author: Crownless_Prince 22 March 2016 12:16:58AM 1 point [-]

At which point the humans running this NN will notice that it likes to go around risk control measures and will... persuade it that it's a bad idea.

How? By instituting more complex control measures? Then you're back to the problem Kaj mentioned above.

Comment author: Lumifer 22 March 2016 04:59:08PM -1 points [-]

How?

In the usual way. Contemporary trading systems are not black boxes full of elven magic. They are models, that is, a bunch of code and some data. If the model doesn't do what you want it to do, you stick your hands in there and twiddle the doohickeys until it stops outputting twaddle.

Besides, in most trading systems the sophisticated part ("AI") is an oracle. Typically it outputs predictions (e.g. of prices of financial assets) and its utility function is some loss function on the difference between the prediction and the actual. It has no concept of trades, or dollars, or position limits.

Translating these predictions into trades is usually quite straightforward.