I have seen this issue despite multiple multiple starter replacements including dealer. Intermittant won't crank trouble. I have it too ever since replacement with rebuild.
Use an ohm meter and test it, if your really worried drop the starter and clean the surfaces. When the problem continues, listen to our Alaskan friend and fix the actual problem.