It's a nonstandard term that seemed appropriate to the discussion. By specialized FAI, I mean an AI that reliably does the thing it was made to do in a specific context.

The difference between specialized FAI and general FAI is like the difference between adaptation executors and fitness maximizers. It's a big difference.

It would be cool if you could tell us about your method for adjusting your values.

How much information is preserved by plastination? Is it a reasonable alternative to cryonics?

Yes, assuming 0 and 1 are not probabilities.

OK, I'll use the same model I use for text. The zeroth-order model is maxentropy, and the kth-order model is a k-gram model with a pseudocount of 2 (the alphabet size) allocated to the (k-1)th-order model.

In this case, since there's never before been a Thursday in which she did not call, we default to the 1st-order model, which says the probability is 3/4 that she will come on Friday.

Which very-low-effort activities are most worthwhile? By low effort, I mean about as hard as solitaire, facebook, blogs, TV, most fantasy novels, etc.

This sounds very complicated. What is the new utility function? The negative of the old one? That would obviously be just as dangerous in most cases. How does the sense of identity actually work? Is every piece of code it writes considered a minion? What about the memes it implants in the minds of people it talks to - does it need to erase those? If the AI knows it will undergo this transformation in the future, it would erase its own knowledge of the minions it has created, and do other things to ensure that it will be powerless when its utility function changes.

The stop button wouldn't stop other AIs created by the original AI.

I suppose a stop button is a positive safety feature, but it's not remotely sufficient.