sbenthall comments on What is optimization power, formally? - Less Wrong

10 Post author: sbenthall 18 October 2014 06:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (15)

You are viewing a single comment's thread. Show more comments above.

Comment author: sbenthall 21 October 2014 12:16:02AM 1 point [-]

Norbert Wiener is where it all starts. This book has a lot of essays. It's interesting--he's talking about learning machines before "machine learning" was a household word, but envisioning it as electrical circuits.

http://www.amazon.com/Cybernetics-Second-Edition-Control-Communication/dp/026273009X

I think that it's important to look inside the boxes. We know a lot about the mathematical limits of boxes which could help us understand whether and how they might go foom.

Thank you for introducing me to that Concrete Mathematics book. That looks cool.

I would be really interested to see how you model this problem. I'm afraid that op-amps are not something I'm familiar with but it sounds like you are onto something.

Comment author: Gunnar_Zarncke 21 October 2014 10:19:10AM 0 points [-]

Thank you for the book. Just ordered it.

Thank you for introducing me to that Concrete Mathematics book. That looks cool.

You're welcome. It is the most fun math book I ever read.

I would be really interested to see how you model this problem.

Currently it is just a bunch of PDEs on paper. But I really want to write a post on this as this could provide some mathematical footing for many of the fooming debates.

One problem I'm stumbling with is the modelling of hard practical physical limits on computational processes. And I mean really practical limits that take thermodynamic into account, not these computronium bounds that are much too high. Something that takes entropic cost of replication and message transfer into account.