I use these expert governors to govern large, newly conquered cities. I nurture particular characters to keep problem cities happy, transferring appropriate followers/retinue (who increase happiness, sanitation, health and management) from other characters to these special governors. In cities with happiness problems, I build every building that reduces squalor, increases happiness and educates family members in that city (e.g. I bring town watch type units to guard newly conquered cities. I recruit units in cities where the people are becoming unhappy (this keeps population down, which results in a happier population). (I choose Normal campaign difficulty - keeping people happy is difficult enough on this level.)
I select huge unit size before I start a campaign.