It depends, in some areas, on the availability of water. If water is scarce camping near it is a poor idea and should be avoided. Being willing to pack your water into dry area is a good way to avoid the crowds and find big Mule Deer. Carrying water isn't fun but finding big deer certainly is.
mike r