Rationality requires intelligence, and the kind of intelligence that we use (for communication, progress, FAI, etc.) runs on language.
It seems that the place we should start is optimizing language for intelligence and rationality. One of SIAI's proposals includes using Lojban to interface between humans and an FAI. And of course, I should hope the programming language used to build a FAI would be "rational". But it would seem to me that the human-generated priors, correct epistemic rationality, decision theory, metaethics, etc. all depend on using a language that sufficiently rigorously maps to our territory.
Are "naturally evolved" languages such as English sufficient, with EY-style taboos and neologisms? Or are they sick to the core?
Please forgive and point me towards previous discussion or sequences about this topic.
The purpose of this reply, relative to my post, is ambiguous to me. I'm unsure if you're proposing that nothing about our language need change in order to end up with correct answers about the "big problems", or if this is simply a related but tangential opinion. Could you clarify? And no, I'm not saying this to prove a point :)
That's exactly what I'm saying, that natural language isn't broken, and in fact that most of what Lojbanists (and other people who complain about natural language being ambiguous) see as flaws are actually features. Most of our brain doesn't have a rigid logical map, so why have a rigid language?