an image refocusing method for use in an image processing apparatus is provided . the image processing apparatus has an image capturing unit and an image processing unit . the method has the following steps of : receiving lights of a scene via the image capturing unit to output a raw image having information of different views ; rearranging the raw image from the image sensor to obtain multiple different view sub - images ; performing a refocusing process to at least one specific view sub - image of the different view sub - images corresponding to a specific view to generate multiple refocused view images , wherein a first focusing position of the refocused view images is different from a second focusing position of the at least one specific view sub - image ; and outputting the refocused view images to a stereoscopic display device .