This is technically just a link post for those who didn't see the book yet. The main idea, as I understand it, is that while some physical theories are beautiful, other are complex and "ugly". Beauty should not be taken as evidence for truth.
It looks like sometimes in AI safety research aesthetics may be taken as an evidence (I will not provide examples, as in each case it may be just my interpretation), and thus possibility of such beauty bias should be taken into account.
Sure, but the fact that the probability distribution is skewed in favor of simpler (i.e. more "beautiful") explanations by Occam's Razor is equivalent to saying that there should be such a bias -- after all, bias is essentially just a skewing of one's probability function. Of course this bias shouldn't be taken to the extreme of assuming that just because one hypothesis is more beautiful than others, it automatically qualifies as the correct explanation. But discrediting such an extreme mindset doesn't mean that a mild bias in favor of "beauty" is discredited.