From anecdotal evidence, it is quite common to give up sugary sodas while still eating other sweets. If you currently drink soda, consider starting by trying to replace them without worrying about other sweets.

Also, I recently changed up a sugar-purchasing habit - there's a shop along my typical walking route to work where I got into the habit of buying candy. I switched this habit to buying sunchips, and then eventually dropped it.