I'd still go with a .22mag if it were me (actually a 25-20 or downloaded .357 if it were me). .22mag is leagal for deer in Maine and SC, if I remember correctly.

If you are determined to go this route, look at an actual deer skull, the temple is obviously the softest spot.