You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

okay comments on [Link]"Neural Turing Machines" - Less Wrong Discussion

16 Post author: Prankster 31 October 2014 08:54AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (21)

You are viewing a single comment's thread. Show more comments above.

Comment author: okay 31 October 2014 07:59:26PM *  2 points [-]

It's not really RAM, but rather a tape. (like a doubly linked list) The LSTM controller can't specify any location in logarithmic space / time. They add multiple tape readers at one point though.

Comment author: Gunnar_Zarncke 31 October 2014 10:25:27PM 0 points [-]

This tape could be compared to the phonological loop and the stream of consciousness.