No matter what you do it will never be big enough. How big is your mill? It will never be big enough. Start with a floor model drill press.
I don’t have a mill yet but I learned on a Bridgeport so probably something along those lines.
Not sure about the shop size but where you located at? I’m asking because I’m located in Axtell and was curious about your location because there seems to be a shortage of smiths near me
Near Gatesville.