The question is can the the other person in the dispute do it without escalating. If the other person escalates to the point that you need to use your CCW, then you'll likely wish you had gone to great lengths to avoid the verbal altercation. Even when the use of force is legally justified, it's likely to be a damn nightmare.
Yep, it's a gamble.