Consider a line drawn then. Even I'm on board. However, Marcello, Manuel and Quasi, I am that lay audience and this is some of the most fascinating stuff I've ever read. I'm probably not going to contribute to coding a protean AI (other stuff on my plate) but I do appreciate the effort Eliezer's making to bridge the inferential gap. And if that's not good enough, well, then the best way to understand something inside out and back to front is to explain it to someone else, right?

So, how does one go about formalising the complex calculations behind 'right'? How do we write it out so it's as universally comprehensible and objective as primality? How do you even start?