I don't look forward to it but sometimes there is not much choice. I was drawn for a highly restricted munitions plant on an archery hunt one time that was either hunt it that one day or not get to hunt it at all. It set in raining early and piss poured most of the day. I slipped up on a nice buck that was bedded and made a decent shot on it, but ended up losing it due to the rain washing away any blood when it hit a power line opening. I didn't have a choice but to push it.

A light drizzle doesn't make much difference to the deer as far as feeding and browsing that I can tell. Let the rain set in hard and the deer will most likely lay down, at least that has been my experience. If I am gonna stick it out during a steady down pour I will be on the ground slipping looking for deer laying down. If your prepared for it can still be a lot of fun.