Well to end this, took it to the gunsmiths and the verdict was it just does not like 180 grain Federal spitzer bullets. Nothing he could find wrong. He ran 3 other types thru it with no problem. He did say the gun was in really good shape, the bore looked almost new, lever and bolt were tight.
Guess it's time to find some dies and bullets. Thanks for the input.