Love this idea- though maybe serfs instead of slaves- it was the term used in other settlers games so that would pass without 100 different humanitarians banging on the door :P
And maybe even other great rewards such as taking over small islands that you then keep close to your mainland, that way long-time players won't get bored by returning to the same old mainland