Just ignore it. You're not going to get his rights involuntarily terminated unless he is a real dirtbag. And yes, while jurisdiction goes with the child, the original court still has continuing jurisdiction and if he still lives in said jurisdiction, it stays in that court regardless of where the child goes.
Just ignore him and have as little to do with him as possible. People like that only have power over you if you let them. For better or worse, your wife has a relationship with him until the child is an adult at the very least. Grit your teeth and bear it unless it becomes something that you just can't ignore because it threatens to harms the child.
