A perfectly rational agent would scarcely ever want to lose the ability to like something, since that would always lower their utility.
What is a perfectly rational self-modifying agent? I don't think anyone has an answer to that, although surely it is something that MIRI studies. The same argument that proves that it is never rational to cease liking something, proves that it must always be rational to acquire a liking for anything. You end up with wireheading.
If it's worth saying, but not worth its own post (even in Discussion), then it goes here.
Previous Open Thread
Notes for future OT posters:
1. Please add the 'open_thread' tag.
2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)
3. Open Threads should be posted in Discussion, and not Main.
4. Open Threads should start on Monday, and end on Sunday.