The rule as usually understood is that fewer relates to discrete quantities, fewer apples, and less to continuous quantities, less milk. It's possibly rather artificial, and noticeably lacking a counterpart in "more".