How do you keep the flip up cap from hitting the bill of your hat? I have tried some of the flip ups but was always bothered that they made contact with my hat.