Of course you need to build the tavern so you can get the extra generals, explorers,and geologists but for long periods in the game it just sits there using up a building licence as its build costs are low i suggest tearing it down reuse the licence of something more productive.And build it again if and when you need it.