Screw the gloves, shucking mittens or mufflers, get a pair of mittens with a trigger finger.
These are buckskin with a flannel liner. I add thin polypropylene gloves if needed for colder temps. In extreme cold temps, I stuff HotHand warmers in. This allows quick, easy access thru the trigger guard and touch on the trigger.