The residual stress generated during heat treatment of nickel-base superalloys will affect their service performance and introduce primary cracks. In a component with high residual stress, a tiny amount of plastic deformation at room temperature can release the stress to a certain extent. However, the stress-releasing mechanism is still unclear. In the present study, the micro-mechanical behavior of the FGH96 nickel-base superalloy during room temperature compression was studied using in situ synchrotron radiation high-energy X-ray diffraction. The in situ evolution of the lattice strain was observed during deformation. The stress distribution mechanism of grains and phases with different orientations was clarified. The results show that at the elastic deformation stage, the (200) lattice plane of γ′ phase bears more stress after the stress reaches 900 MPa. When the stress exceeds 1160 MPa, the load is redistributed to the grains with their <200> crystal directions aligned with the loading direction. After yielding, the γ′ phase still bears the main stress.