After some more testing of long exposures ive found that the wobble is nearly repeatable throughout all photos, it always makes a U or V shape. I took a time-lapse of the tracker at 5s intervals and found that the output does in fact wobble.

Now working to find the cause of this, my thinking is it is one of the bearing drives. Maybe if they are not dead straight then it could cause the flex cup to oscillate.