If you have access to a high lift jack, or a hand winch, you can try using this as an aid to digging the stumps out. Has worked for me well in the past.
Only really a consideration if the stump is tall enough to gain any appreciable leverage to make the job easier (why I leave about 5-6 foot of stump when I've cut down trees), and there is a solid anchor point near-by that you can run your line to.