Noise level of one shot fired from a .223 vs one shot fired from a .375 would not concern me. What happens after the shot does.

Poor placement, marginal power, and/or poor bullet selection resulting in a dead/dying animal on your neighbor's lawn........or in his swimming pool (yes)........will be a concern.

More than anything else, place the bullet well.