When I jerk a shot, and I shoot infrequently enough that I jerk more than a few, its always low and to the left.
I'm assuming you're shooting right handed. My son shoots left handing and when he jerks shots they go right, and he only does it with my single stack 1911's, which has a narrower grip than all his double stacks.
So at least for me, cause you may be very different....
If I look close I can see two patterns overlapping on the target, one that are my good shots the other where I jerk shots.
If I anticipate the recoil, I shoot low, if I apply side force on the trigger or squeeze my grip fingers while also my trigger finger, the shot goes left.... ...squeezing with the other fingers while pulling the other trigger seems to happen more often when I'm not used to the grip size and thus the position of my fingers.... ....and funny since my son shoots with the left hand and doesn't anticipate, but since the 1911 grip is so foreign to him compared to all his other pistols, he pulls off to the opposite direction but the same way when he's trying to get used to the much narrower grip....
You may have a definite single pattern on the target and it is the sights are off an MOA or two...
I dry fire my pistols, especially new ones, to get used the grip... ...and one thing I do, I dry fire not through the sights but looking at the pistol as a whole instead... ...when I have the grip right and my habits right, so I don't squeeze other fingers other than the trigger finger, the pistol is rock solid through the sear realease and striker coming to rest... ...when its not right, I can see the pistol pull to the left just a hair... ...its either me squeezing my fingers around the grip with the trigger OR I have my finger positioned wrong on the trigger (and that varies from pistol to pistol a bit) and the natural pull of my finger, the force from it, is not directed directly rearward the entire pull, it has side force to the pull because of placement of my fingertip on the trigger and that causes the pistol to pull to the left a bit.