Its bullet balance, stability and strength and bore condition.
To a large degree its similar things that cause inaccurate cast bullets; bullets that do not hold together to impart rotational forces and friction pressure from speed tend to be inaccurate.
Both can be hard on an unbalanced, thin jacketed or cheaply made bullet, regardless of weight, to a certain degree.
