I don't believe I have it in for a cartridge.

I don't find using a 300 mag or whatever for deer silly in and of itself. What I may find silly is someone's reason for doing so.