Your first paragraph is reasonable, but quantum physics works in discrete systems. The most extreme case is quantum computation, which often uses finite dimensional Hilbert spaces. But older and more mainstream is lattice gauge theory, which I believe approximates QFT with a discrete quantum system.