Rectal cancers are often considered a distinct disease from colon cancers as their survival and management are different. Particularly, the risk for local recurrence (LR) is greater than in colon cancer. There are many factors predisposing to LR such as postoperative histopathological features or the mesorectal plane of surgical resection. In addition, the pattern of LR in rectal cancer has a prognostic significance and an important role in the choice of operative approach and. Therefore, an optimal follow up based on imaging is critical in rectal cancer. The aim of this review is to analyse the risk and the pattern of local recurrences in rectal cancer and to provide an overview of the role of imaging in early detection of LRs. We performed a literature review of studies published on Web of Science and MEDLINE up to January 2023. We also reviewed the current guidelines of National Comprehensive Cancer Network (NCCN) and the European Society for Medical Oncology (ESMO). Although the timing and the modality of follow-up is not yet established, the guidelines usually recommend a time frame of 5 years post surgical resection of the rectum. Computed Tomography (CT) scans and/or Magnetic Resonance Imaging (MRI) are the main imaging techniques recommended in the follow-up of these patients. PET-CT is not recommended by guidelines during post-operative surveillance and it is generally used for problem solving.