timtyler comments on Against Discount Rates - Less Wrong

23 Post author: Eliezer_Yudkowsky 21 January 2008 10:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (80)

Sort By: Old

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 17 March 2011 10:33:35AM *  -1 points [-]

Not exactly an assumption. We can see - more-or-less - how the fundamental reward systems in the brain work. They use neurotransmitter concentrations and firing frequencies to represent desire and and aversion - and pleasure and pain. These are the physical representation of utility, the brain's equivalent of money. Neurotransmitter concentrations and neuron firing frequencies don't shoot off to infinity. They saturate - resulting in pleasure and pain saturation points.

Comment author: FAWS 17 March 2011 10:45:15AM 3 points [-]

I see little indication that the brain is in the assigning absolute utilities business at all. Things like scope insensitivity seem to suggest that it only assigns relative utilities, comparing to a context-dependent default.

Comment author: rwallace 17 March 2011 01:24:02PM 0 points [-]

They are feedback signals, certainly. Every system with any degree of intelligence must have those. But feedback signals, utility and equivalent of money are not synonyms. To say a system's feedback signals are equivalent to money is to make certain substantive claims about its design. (e.g. some but not most AI programs have been designed with those properties.) To say they are utility measurements is to make certain other substantive claims about its design. Neither of those claims is true about the human brain in general.