Men go to zero

[Dafyd]

I've had a constant problem with the men going to zero even though I haven't exhausted them in growing. This only happen when capturing free castles