I had similar issues to the OP when flying home today a few times. I had installed a sunhans booster for video signal and flew trouble free to a distance of 4,000 ft.
Turned around to fly back and the drone would occasionally spin when I wasn’t turning, or turn opposite of my left/right...