You'll be doing something to trigger it - you can turn off auto-use of CCs (a good idea) via the Settings page (pick the 'candy coins' button then uncheck both options). Usually what wil be happening is something 'offensive': either you trying a kidnap or raid, or someone doing the same to you.