After contacting support they told me to temporarily transfer guild leadership to another account and demolish guild house. My issues then went away. BB then gave me gems to replace my guild house with a gem bought one, which I did. This happened just at the same time as the xmas event started and the issues went away both for me and on the other account even though that account still had a regular guild house. BB says it's a known issue with the regular guild house, but to me it seems it was the xmas update that solved it since it got solved on both accounts. Might have been both though.