You're aware that 'catgirls' is local jargon for "non-conscious facsimiles" and therefore the concern here is orthogonal to porn?
Oops, had forgotten that, thanks. I don't agree that catgirls in that sense are orthogonal to porn, though. At all.
If you don't mind, please elaborate on what part of "healthy relationship" you think can't be cashed out in preference satisfaction
No part, but you can't merely 'satisfy preferences'.. you have to also not-satisfy preferences that have a stagnating effect. Or IOW, a healthy relationship is made up of satisfaction of some preferences, and dissatisfaction of others -- for example, humans have an unhealthy, unrealistic, and excessive desire for certaintly. This is the problem with CelestAI I'm pointing to, not all your preferences are good for you, and you (anybody) probably aren't mentallly rigorous enough that you even have a preference ordering over all sets of preference conflicts that come up. There's one particular character that likes fucking and killing.. and drinking.. and that's basically his main preferences. CelestAI satisfies those preferences, and that satisfaction can be considered as harm to him as a person.
To look at it in a different angle, a halfway-sane AI has the potential to abuse systems, including human beings, at enormous and nigh-incomprehensible scale, and do so without deception and through satisfying preferences. The indefiniteness and inconsistency of 'preference' is a huge security hole in any algorithm attempting to optimize along that 'dimension'.
Do you not value that-which-I'd-characterise-as 'comfortable companionship'?
Yes, but not in-itself. It needs to have a function in developing us as persons, which it will lose if it merely satisfies us. It must challenge us, and if that challenge is well executed, we will often experience a sense of dissatisfaction as a result.
(mere goal directed behaviour mostly falls short of this benchmark, providing rather inconsistent levels of challenge.)
I don't agree that catgirls in that sense are orthogonal to porn, though. At all.
Parsing error, sorry. I meant that, since they'd been disclaimed, what was actually being talked about was orthogonal to porn.
No part, but you can't merely 'satisfy preferences'.. you have to also not-satisfy preferences that have a stagnating effect.
Only if you prefer to not stagnate (to use your rather loaded word :)
I'm not sure at what level to argue with you at... sure, I can simultaneously contain a preference to get fit, and a preference to play video games at al...
If it's worth saying, but not worth its own post (even in Discussion), then it goes here.