His pond, his rules. That's how it should be.
Folks down south just seem like ass holes about their precious property. They act like they figure you're going to steal their ground one bucket full of dirt at a time or something. I've asked to fish in lots of private ponds around here and don't recall ever being turned down. I'm not talking friends or neighbors either but perfect strangers. See a pond I'd like to fish. Knock on the door and ask politely. Folks say sure, go ahead.