Well, first it has to become dominant enough (for which it'd need to be common enough, for which it needs to be useful enough - used for what?), then the hardware specialization is not easy either, and on top of that specialized hardware locks the designs in (prevents easy modification and optimization). Especially if we're speaking of specializing beyond how GPUs are specialized for parallel floating point computations.