As the concept of Industry 4.0 is introduced, artificial intelligence-based fault analysis is attracted the corresponding community to develop effective intelligent fault diagnosis and prognosis (IFDP) models for rotating machinery. Hence, various challenges arise regarding model assessment, suitability for real-world applications, fault-specific model development, compound fault existence, domain adaptability, data source, data acquisition, data fusion, algorithm selection, and optimization. It is essential to resolve those challenges for each component of the rotating machinery since each issue of each part has a unique impact on the vital indicators of a machine. Based on these major obstacles, this study proposes a comprehensive review regarding IFDP procedures of rotating machinery by minding all the challenges given above for the first time. In this study, the developed IFDP approaches are reviewed regarding the pursued fault analysis strategies, considered data sources, data types, data fusion techniques, machine learning techniques within the frame of the fault type, and compound faults that occurred in components such as bearings, gear, rotor, stator, shaft, and other parts. The challenges and future directions are presented from the perspective of recent literature and the necessities concerning the IFDP of rotating machinery.