I can't tell any difference between mule deer and anything else, myself. Even if they've been rutting, if the critter is cooled down quickly it should be OK.
Are you hunting sagebrush deer or mountain deer? Farmground? That's made a bigger flavor difference for me than anything else.
