That is correct. Here is an article based on that earlier survey which includes a cool chart of faith switching. A plurality of "nones" were previously Catholic.
I've heard before that if you count denominations, catholics have the most and former catholics are more numerous than any other individual religious organization.
A new study by the Pew Forum on Religion and Public Life [executive summary; full report; New York Times cover story] found that 19.6% of adult Americans answered a question about their current religion by saying they were atheist, agnostic or “nothing in particular.” In 2007, the figure was 15.3%; in 1972, it was about 7%.
Some relevant quotes from the executive summary: