Both the Roman and especially Charlemagne's empires were archipelagos compared to today's states. Both contained many sub-states that where mostly left to govern themselves as long as they acknowledged imperial authority and paid taxes.