Maybe its working as 'Designed', but is it working as it 'should'?
:)
Ie. if you build in the wrong place it should be possible to demolish the error and carry on from that point without the quest condition throwing a sulk. Compared to a regular adventure when one of your generals gets defeated, the adventure can continue subject to time limits, resources and general availability.