We looked at doing this last year, but it's tricky due to another site feature - when a post's comment count gets large low vote comments threads get collapsed to "load more comments" links. It wasn't obvious (in the small time we put into it) how to make sure the comment you were permalinking actually appeared on the main post in its default state.
(It's obviously possible - just trickier than trivial.)