Independent Researcher
Lucas D. Lingle
Transformer;Transformer Decoder;Decoder-Only Transformer;Natural Language Processing;NLP;Vector Quantization;VQ;K-Means;Clustering;Causal Attention;Autoregressive Attention;Efficient Attention;Linear-Time Attention;Autoregressive Modeling;Generative Modeling;Gated Attention;Compressive Attention;Kernelized Attention;Kernelizable Attention;Hierarchical Attention;Segment-Level Recurrent Attention;Long-Context Modeling;Long-Range Modeling;Long-Range Dependencies;Long-Term Dependencies;Cached Attention;Shift-Equivariant Attention
Transformer-VQ: Linear-Time Transformers via Vector Quantization