Data61 CSIRO‡Australian National University; Data61 CSIRO†Queensland University of Technology
Maryam Haghighat, Peyman Moghadam, Shaheer Mohamed, Piotr Koniusz
Random Projection;Self-supervised Learning;Image Modelling;Representation Learning;Vision Transformer
Pre-training with Random Orthogonal Projection Image Modeling