According to sources such as Lyman, batteries might contain alloys including very toxic metals like cadmium. Aside from not knowing what you're alloying with otherwise perfectly good billet casting metal, I don't believe the health risks of unknown metals makes it worthwhile.
