Stanford University
Jesse Mu, Xiang Li, Noah Goodman
language models;instruction finetuning;prompt compression;distillation;context distillation;prompting;soft prompting;efficiency
Learning to Compress Prompts with Gist Tokens