Yes, and in the limit of obtaining more data indefinitely, the in-between regions will shrink indefinitely (at least if you're using k-nearest-neighbors and not smooth kernels).