National Institute of Advanced Industrial Science and Technology (AIST); National Institute of Advanced Industrial Science and Technology (AIST), Tokyo Institute of Technology
Sora Takashima, Ryo Hayamizu, Nakamasa Inoue, Hirokatsu Kataoka, Rio Yokota
Visual Atoms: Pre-Training Vision Transformers With Sinusoidal Waves