Interesting concept. Since none of this is going to be a fast process have you considered a few different molds in various sizes? Aluminum molds for a few common calibers, eliminate the sizing issue. Toss in a few handfulls of assorted lead bullets that could be used as is or recast for your needs.
