I think that unfortunately might be ingrained into the game's code, which would mean it's unalterable. Have you tried turning Free-Flight on while in turret view? It alters how the camera handles when using keys to turn the ship in turret view (often called Turret Steering) immensely.
