Look at the match results posted by competitors in the Cast Bullet Association before condemning cast bullet accuracy. But, as with most such things in life, there's a caveat: good usable field accuracy is attainable with just a passing nod to the protocols involved, but if you want stunningly great accuracy you better pay strict attention to the protocols. It's a thinking man's game if you want to take it to the next level and beyond. (And therein lies the attraction for many people.)
Don't be afraid. Accept it as a challenge, and give it a whirl.
