You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Gunnar_Zarncke comments on [Link] An exact mapping between the Variational Renormalization Group and Deep Learning] - Less Wrong Discussion

5 Post author: Gunnar_Zarncke 08 December 2014 02:33PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (9)
Tags: learning machine agi

Comments (9)

You are viewing a single comment's thread. Show more comments above.

Comment author: Gunnar_Zarncke 08 December 2014 05:46:52PM 0 points [-]

Universality of functions: Yes (inefficiently so). But the claim made in the paper goes deeper.

Comment author: Punoxysm 08 December 2014 08:55:55PM 0 points [-]

Can you explain? I don't know much about renormalization groups.

Comment author: Gunnar_Zarncke 08 December 2014 09:31:59PM 0 points [-]

The idea behind RG is to find a new coarse-grained description of the spin system where one has “integrated out” short distance fluctuations.

Physics has lots of structure that is local. 'Averaging' over local structures can reveal higher level structures. On rereading I realized that the critical choice remains in the the way the RG is constructed. So the approach isn't as general as I initially imagined it to be.

Powered by Reddit Powered by Reddit