Way too many variables in the system to be certain what causes that sort of thing... but it is NOT the bullet suddenly going unstable or wandering as a function of the bullet.
Among the suspects would be parallax in the sighting system, number one.
A poor fit between reticle and target at the longer range can create issues both because of the physical characteristics of the optics and target and because of eye variations in different people.
Unseen weather at the longer distance creating air movement...
And many more, but bullets are not the problem.
