As the number of Internet of things (IoT) devices increases exponentially, scheduling and managing the radio resources for IoT devices has become more important. To efficiently allocate radio resources, the base station (BS) needs the channel state information (CSI) of devices every time. Hence, each device needs to periodically (or aperiodically) report its channel quality indicator (CQI) to the BS. The BS determines the modulation and coding scheme (MCS) based on the CQI reported by the IoT device. However, the more a device reports its CQI, the more the feedback overhead increases. In this paper, we propose a long short-term memory (LSTM)-based CQI feedback scheme, where the IoT device aperiodically reports its CQI relying on an LSTM-based channel prediction. Additionally, because the memory capacity of IoT devices is generally small, the complexity of the machine learning model must be reduced. Hence, we propose a lightweight LSTM model to reduce the complexity. The simulation results show that the proposed lightweight LSTM-based CSI scheme dramatically reduces the feedback overhead compared with that of the existing periodic feedback scheme. Moreover, the proposed lightweight LSTM model significantly reduces the complexity without sacrificing performance.