This would be a bit more obvious if we cut the rhomb to have edge of equal axis.
Based on the total-reflection phase transformation theory, the Fresnel rhomb retarder is obtained with a structure Angle with which the phase retardation is insensitive to the Angle of incidence.