Losing track due to motion blur

I’ve got a great track except for 2 frames.

 

I’ve tried changing to manual track but the surface tool is miles away and when I adjust it to fit where I want it, it then is miles away from where I placed it on the rest of the track

 

help?

When you say the surface is “Miles away” do you mean it’s very small in the screen because it’s tracked in perspective?
Are the two frames at the very ends of the shot, or somewhere in the middle?

Apologies. let me clarify.

 

no I don’t mean far away in z space. I mean the x and y of the surface tool are quite a long way off the xSpline on those 2 frames.

 

the 2 frames are at the very beginning of the composition