Replace it with, say, a bunch of petty little dictators who refuse to cooperate with each other and pretty soon the population starts starving to death and wishing for the good old days when Servalan was in charge.
Sounds like Avons' scheme in Warlord.