I think any FAI-generated [e]utopia worth calling one would have to allow safe self-modification abilities and the right to choose one's own fun, so you have little to worry about in this respect. Though if things go well, there'll be forms of fun available to us (both wireheady/sensory and externally-motivated fun) that are orders of magnitude better than any you can imagine now; I support your right to scratch as many itches and listen to as much recent popular music as you want indefinitely into the future, and any FAI should as well, but you probably won't actually keep wanting to do all of these for very long.
I think the future will be more complex than that. The fact that unbounded fun will be available to me points to the hypothesis that at some moment a revolutionary modification of our body-mind structure will be necessary.
but you probably won't actually keep wanting to do all of these for very long.
The original post was stating clearly that I could possibly will. And to please not encode your skepticism into an AI :)
This post is a formal request for everybody in this forum, who are the most likely humans to produce an FAI in the future, that in the possible resulting utopia some activity will still be available, even if they are not based on challenges of increasing complexity. I call these activity natural wireheadings, and since it is my right to determine my own fun-generating activities, I hereby formally request that some simple pleasure, listened below, will still be available at *any* point in my future cone, and that I will consider a dystopia any future which deprives me of these natural wireheadings (if anyone is still around caring for those things).
A (non-exhaustive) list of them includes the following:
- sex
- eating food/drinking
- feeling relieved for having emptied my bowels
- dancing
- the pleasure of physical activity (wood-carving, sculpting, running, etc)
- the rapture I feel when in the presence of a safe ancestral environment
- social laughter
- the pleasure of talking in a small, same-minded crowd
- listening to pop/metal/rap music
- the pleasure of resting when tired
- scratching an itch
-...
More will come!