The obstacle I see as most formidable in such an undertaking is the fact that, no matter how much “rational software” our brains absorb, we cannot escape the fact that we exist within the construct of “irrational hardware”.
It's possible to design some 'rational software' that corrects for known or expected 'irrationalities' in the hardware. (A trivial example: if our hardware makes decisions by picking randomly from the set of possible decisions, software that provides a list of possible decisions ranked from best to worst will obviously fail. So the software should order all possible decisions, then make only the top of the list available to the hardware.)
As far as I can tell, being purely rational is in direct opposition to being human.
This makes no sense. It might be helpful for me to say that there's no such thing as "being purely rational": one can be a rational human, or a rational alien, or a rational computer, but one can't be a rational. It's necessarily an adjective of some condition; it's a two-place word.
The reason there is not a “School of Super Bad Ass Black Belt Rationality” could be as simple as…. It doesn't make people want to mate with you.
It probably would give you the skills you'd need to learn how to become the kind of person who people do want to mate with. If only because it would give you the skills to learn how to become the kind of person you want to be, in general.
1) Sex ... 2) Mortality ... 3) Food, water, shelter.
If these are your desires and you wish to have them, then use rationality's skills to obtain them most efficiently: polyamory, relationship skill, and birth control / protection can drastically increase the frequency and intensity of sex. Organisations like SENS are attacking the mortality problem; support them while learning about existing life extension methods like healthy eating. Determine how much food, water, and shelter you need and optimise your environment so you receive enough of each with arbitrarily high probability and arbitrarily low effort.
If being rational conflicts with my ability to provide my body with its basic needs...
Then you have named the art, and failed the 12th virtue.
polyamory, relationship skill, and birth control / protection can drastically increase the frequency and intensity of sex
He probably meant that sex is something a rational being would avoid rather than maximise.
I am passionately fond of the idea of creating an “Art of Rationality” sensibility/school as described in the [A Sense That More is Possible](http://lesswrong.com/lw/2c/a_sense_that_more_is_possible/) article.
The obstacle I see as most formidable in such an undertaking is the fact that, no matter how much “rational software” our brains absorb, we cannot escape the fact that we exist within the construct of “irrational hardware”.
My physical body binds me to countless irrational motivations. Just to name a few: 1) Sex. In an overpopulated world, what is the benefit of yearning for sexual contact on a daily basis? How often does the desire for sex influence rational thought? Is “being rational” sexy? If not, it is in direct conflict with my body’s desire and therefore, undesirable (whereas being able to “kick someone’s ass” is definitely sexy in cultural terms) 2) Mortality. Given an expiration date, it becomes fairly easy to justify immediate/individually beneficial behavior above long term/expansively beneficial behavior that I will not be around long enough to enjoy. 3) Food, water, shelter. My body needs a bare minimum in order to survive. If being rational conflicts with my ability to provide my body with its basic needs (because I exist within an irrational construct)… what are the odds that rationality will be tossed out in favor of irrational compliance that assures my basic physical needs will be met?
As far as I can tell, being purely rational is in direct opposition to being human. In essence, our hardware is in conflict with rationality.
The reason there is not a “School of Super Bad Ass Black Belt Rationality” could be as simple as…. It doesn't make people want to mate with you. It’s just not sexy in human terms.
I’m not sure being rational will be possible until we transcend our flesh and blood bodies, at which point creating “human friendly” AI would be rather irrelevant. If AI materializes before we transcend our flesh and blood bodies, it seems more likely that human beings will cause a conflict than the purely rational AI, so shouldn't the focus be toward human transcendence rather than FAI?