A word of caution here, what you have just stated is enough for a hunter harassment violation.
Also it opens you up to some liability issues I suspect if he gets injured following the moved markers.
You might be best off contacting the local CO or Sheriff's dept.