Apple
Iman Mirzadeh, Keivan Alizadeh-Vahid, Sachin Mehta, Carlo C del Mundo, Oncel Tuzel, Golnoosh Samei, Mohammad Rastegari, Mehrdad Farajtabar
Large Language Models;Sparsity;Activation Function;ReLU Activation Function
ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models