Neuroscience Institute, Carnegie Mellon University; Center for the Neural Basis of Cognition, Pittsburgh; Machine Learning Department, Carnegie Mellon University; Rehab Neural Engineering Labs, University of Pittsburgh; Neuroscience Institute, Carnegie Mellon University; Center for the Neural Basis of Cognition, Pittsburgh; Rehab Neural Engineering Labs, University of Pittsburgh; Department of Physical Medicine and Rehabilitation, University of Pittsburgh; Department of Bioengineering, University of Pittsburgh; Center for the Neural Basis of Cognition, Pittsburgh; Department of Biomedical Engineering, Carnegie Mellon University
Joel Ye, Jennifer Collinger, Leila Wehbe, Robert Gaunt
Pretraining;Scaling Laws;Neuroscience;Brain-computer interfaces
Neural Data Transformer 2: Multi-context Pretraining for Neural Spiking Activity