I don't know that "the upper middle class and the rich" really think judges are unbiased. Judges are assumed to be biased in any case which directly affects their own interests, or in which the judge knows any of the parties. Also, judges in high-profile positions are often assumed to have political biases -- as is shown in the debates surrounding Senate confirmation hearings, as well as the recent judicial election in Wisconsin. Sometimes the judiciary in general is perceived to have a bias, such as being "soft on crime."

What is not usual is to think that judges are strongly biased by how long it has been since their last meal. A lot of commenters on this thread have expressed skepticism on this point, and I do too.