I'm also stuck at Lvl4 and before reading this thread I have demolished, rebuilt in a different spot and followed all sorts of ideas and instructions! I was ready to quit this morning until I found this. I will now go and demolish my tavern and see if that helps. I really think someone should address this problem because it is frustrating enough to make you quit the game.