How to Outsmart AI in Manor Lords (Tactical Guide)

In part 12 of our walkthrough of the most magnificent medieval city builder / Total War game I sneak past the AI lord to raise a bandit camp.
I get rewarded with more gold and more influence.
I then start the long journey toward upgrading to a level 3 village.
But will my sneaking and "cleverness" be punished by the AI at a later date?