If the satisficer is fine with "make 10 paperclips", but the difference between that and "make 10 paperclips and kill all humans" is small, the satisficer may well go with whatever showed up first in its search algorithm.

Yep, that's the problem. That's why I'm trying to address the issue directly by penalising things like "...and kill all humans".