It’s been noted, though I can’t confirm, that the real sense has ghosts or artifacts left behind by previous areas. The memory is supposed to wipe clean after so many hours/times using it (it’ll remember places it flew before but I’m not sure how large the memory is on it). Sometimes it’ll think it’s flying in an old area it’s flew before and the results are exactly what you’re experiencing.
So:
Sunlight
Dust on lens (q-tip will clean it fine)
Old artifacts left behind in its memory
Can anyone confirm the artifacts theory?