Today, one of the world’s biggest problems is the assurance of food integrity from farm to fork. Economically motivated food adulteration and food authenticity problems are increasing daily with considerable health and economic effects. Early detection and prevention of food integrity-related problems could be provided by the application of effective on-site food analysis technologies. FTIR spectroscopy coupled with chemometrics can be used for the rapid quality control of a wide variety of food products with fast, high-throughput, accurate and nondestructive analysis advantages. In particular, hand-held and portable FTIR instruments have the potential to surveil food quality and food safety in various critical segments of the food supply chain. In this review, we explore the abilities of hand-held and portable FTIR spectrometers combined with multivariate statistics to conduct a quality evaluation of various food products in terms of food adulteration and authenticity issues. An examination of the literature showed that comparable results were obtained based on detection limits, correlation coefficient (R2) values, standard error values and discrimination power by using both portable/hand-held FTIR spectrometers and benchtop FTIR spectrometers. In conclusion, this review highlights the potential usefulness of portable and hand-held FTIR spectrometers combined with chemometrics for maintaining the food quality through the presentation of various applications that may shed light for on-site food control at any point of the food supply chain.