School of ECE, Purdue University
Efficient training of LLMs;Efficient fine-tuning of LLMs;Padding-free variable sequence length batching;Token pruning;Regularizer for LLM training;TokenDrop;BucketSampler
TokenDrop + BucketSampler: Towards Efficient Padding-free Fine-tuning of Language Models