I had an XDs .45, and the grip safety was problematic for me. It was not as ergonomic and positive as the 1911 grip safeties that I used back in the day.
My experience also. I really thought I was going to like the XD but just couldn't warm up to it. I like Glock, but really like the M&P line up the best. I carry a Shield 9mm.