I left my gun outside in well below freezing temps for 2 days. On the 3rd day I shot a buck.
That was this season, using 2 777 pellets...
To the OP - IMLE, leaving the loaded muzzleloader outside, instead of bringing it in and warming it up, is key for winter temps.