In their search for "true beliefs" they would quickly discover that there is no such thing as "actually true" but that science deals in more and more viable models. So, they would abandon their search for "truth" and would go onward to the search for better and better fitting models. (See definitions of science ... and, for a philosophical point of view, radical constructivism).
Our senses don't perceive the "real" world. They build a highly refined and effective illusion of complete perception. (See for example the blind spot in the eye, the physiology of color perception, or our sense of hearing.
Likewise, our minds always use simplified models. No one would be able to catch a falling ball if he had to actually calculate the flight curve - yet, even children are able to do it. That's because if you keep your eyes fixed at the ball and have to lower your head in a constant way you are standing at the right spot to catch the ball. (If your rate of head-lowering is slower you have to move till it is.)
So, doing the actual calculations would be a waste of time, because there's a simpler way to catch a ball.
Even if one uses always the best and newest models science provides, you will never, ever be really at the frontier because so many papers are published every day. And even if one could, scientists are able to err. And do so frequently.
(See for example selection bias. There are LOTS of papers about it.)
So, someone on a quest to find "truth" is a romantic twerp who will accomplish nothing, because he will expect to find something static and final. Science and understanding are processes.
The only fields of human endeavor where you find "truth" are mathematics and religion.
(Most things I mention in this article are findable in the wikipedia. If you don't understand, look them up. Everyone should now about scientific models, "truth" and constructivsm. Oh, and the physiology of our senses.)
See also: Twelve Virtues of Rationality, The Meditation on Curiosity, Use Curiosity
What would it look like if someone was truly curious — if they actually wanted true beliefs? Not someone who wanted to feel like they sought the truth, or to feel their beliefs were justified. Not someone who wanted to signal a desire for true beliefs. No: someone who really wanted true beliefs. What would that look like?
A truly curious person would seek to understand the world as broadly and deeply as possible. They would study the humanities but especially math and the sciences. They would study logic, probability theory, argument, scientific method, and other core tools of truth-seeking. They would inquire into epistemology, the study of knowing. They would study artificial intelligence to learn the algorithms, the math, the laws of how an ideal agent would acquire true beliefs. They would study modern psychology and neuroscience to learn how their brain acquires beliefs, and how those processes depart from ideal truth-seeking processes. And they would study how to minimize their thinking errors.
They would practice truth-seeking skills as a musician practices playing her instrument. They would practice "debiasing" techniques for reducing common thinking errors. They would seek out contexts known to make truth-seeking more successful. They would ask others to help them on their journey. They would ask to be held accountable.
They would cultivate that burning itch to know. They would admit their ignorance but seek to destroy it.
They would be precise, not vague. They would be clear, not obscurantist.
They would not flinch away from experiences that might destroy their beliefs. They would train their emotions to fit the facts.
They would update their beliefs quickly. They would resist the human impulse to rationalize.
But even all this could merely be a signaling game to increase their status in a group that rewards the appearance of curiosity. Thus, the final test for genuine curiosity is behavioral change. You would find a genuinely curious person studying and learning. You would find them practicing the skills of truth-seeking. You wouldn't merely find them saying, "Okay, I'm updating my belief about that" — you would also find them making decisions consistent with their new belief and inconsistent with their former belief.
Every week I talk to people who say they are trying to figure out the truth about something. When I ask them a few questions about it, I often learn that they know almost nothing of logic, probability theory, argument, scientific method, epistemology, artificial intelligence, human cognitive science, or debiasing techniques. They do not regularly practice the skills of truth-seeking. They don't seem to say "oops" very often, and they change their behavior even less often. I conclude that they probably want to feel they are truth-seeking, or they want to signal a desire for truth-seeking, or they might even self-deceivingly "believe" that they place a high value on knowing the truth. But their actions show that they aren't trying very hard to have true beliefs.
Dare I say it? Few people look like they really want true beliefs.