If your brass needs annealing it needed it as soon as you last fired it. I don’t know that it matters enough to notice but I would advise before resizing. That is what I do.