Generative pre-trained language models;Unstructured pruning;Sparse regularization;Model compression
Enhancing One-Shot Pruned Generative Pre-training Language Models through Sparse-Dense-Sparse Mechanism