Incidentally I am reminded of the disturbing science fiction novel Blindsight by Peter Watts, which explores (fictional insight only, of course!) similar ideas.
I just read through that in one long sitting, profoundly existentially terrifying and disturbingly enthralling. Excellent book, but, irrationally, I really hope there's a good counter-argument to it somewhere.
Shiver. I need some chocolate now.
Edit Ended up watching "My little pony," the perfect anti-despair superstimulus. Thinking about it further I suspect theres something to be said in favour of self-awareness in terms of type one and type two processes, self awareness being energy expensive but actually making better decisions, but I don't know enough cognitive science to be sure.
So we say we know evolution is an alien god, which can do absolutely horrifying things to creatures. And surely we are aware that includes us, but how exactly does one internalize something like that? Something so at odds with default cultural intuitions. It may be just my mood tonight, but this short entry on the West Hunter (thanks Glados) blog really grabbed my attention and in a few short paragraphs on a hypothesis regarding the Hobbits of Flores utterly changed how I grok Eliezer's old post.
I have to break here to note that was the most awesome fact I have learned in some time.
That last sentence just struck me with utter horror.