Stanford University; The Allen Institute for AI; University of Southern California; Saarland University
Matthew Finlayson, John Hewitt, Alexander Koller, Swabha Swayamdipta, Ashish Sabharwal
softmax;bottleneck;truncation;sampling;nucleus;top-k;theory;linear programming;linear algebra;decoding;generation;autoregressive;language model;NLP;open-ended generation
Closing the Curious Case of Neural Text Degeneration