This is a normal behavior, as no bundle adjustment has been performed yet. It shows that the initial residual errors of the camera calibration and exterior orientation, before aerial triangulation, are large. Once bundle adjustment is completed, the residual values should improve.