I would still draw file it and finish up by using a piece of stiff leather to back my sandpaper. All the while being very careful to keep the original contour and not put a flat or facet on the side.
99.5% chance anything you do with a Dremel will turn into a train wreck.
