Nous Research; University of Geneva; EleutherAI
Bowen Peng, Jeffrey Quesnelle, Honglu Fan, Enrico Shippole
transformers;nlp;fine-tuning;context window;attention;rotary embedding
YaRN: Efficient Context Window Extension of Large Language Models