= 27d567bc2d48d9f40e9ccc20ea370b15)
IlyaShpitser comments on Open thread, Nov. 16 - Nov. 22, 2015 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (185)
I don't think any one person understands the Linux kernel anymore. It's just too big. Same with modern CPUs.
An RNN is something that one person can create and then fail to understand. That's not like the Linux kernel at all.
Correction: An RNN is something that a person working with a powerful general optimizer can create and then fail to understand.
A human without the optimizer can create RNNs by hand - but only of the small and simple variety.
Although the Linux kernel and modern CPUs are piecewise-understandable, whereas neural networks are not.
Lots of neural networks at an individual vertex level are a logistic regression model, or something similar, -- I think I understand those pretty well. Similarly: "I think I understand 16-bit adders pretty well."