I use the RCBS Case Lube II that's water soluble. Simply rinse and leave them in the sun or an oven set at its lowest for a couple of hours.
Annealing temperature is around 800 degrees, so I set an extra cookie sheet on a shelf between the brass and heating element so there is no possibility of radiant heating of the brass.
