I never had to remove one.
What I would do is put the bolt in a padded vice, hold a small screwdriver, etc. on one end of the extractor, use a pointed tool to work under the other edge and just peal it out of the recess. I have a couple of those pointed gunsmith tools that would work, sorta like an extra fine ice pick.
Others (who have actually done it
) may want to chime in and let us know if they have a better way.
DF