Sounds like you picked a poor place to live. It's no accident I live where I do. A couple of the criteria I had when I bought this place were....

1. Must be far enough from neighbors so as to be able to shoot in the yard or out the living room window as I choose.

2. Must be in a location with plenty of public hunting land and good fishing in close proximity.

The place I ended up buying met both of those criteria plus is next door to long time family friends with 126 acres which I have permission to hunt on freely. It's also right across the road from 200 acres owned by a non hunting absentee landowner that I have permission to hunt as much and as often as I want.