I think it comes down to where you plan to go, the weather temperature, what you have in stock, etc.

For awhile I had my NAA mini-revolver that I mostly carried, I often forgot it was in my pocket, very comfortable to carry. The Ruger LCP for riskier places, but it is slightly larger and heavier. I sold the NAA gun as I did not feel it was adequate for going up against someone who had a Glock, etc.

I have larger handguns that would be almost impossible to carry in my pocket, but I could see bringing them along in a hip holster to a place I knew to be a risk being there.

I used to carry a Smith and Wesson large frame .357 magnum on hikes in the Oregon Cascades in case of bear risks.