Center for Brain Science, Harvard University, Cambridge, MA, USA; EECS Department, University of Michigan, Ann Arbor, MI, USA; EECS Department, University of Michigan, Ann Arbor, MI, USA; Center for Brain Science, Harvard University, Cambridge, MA, USA; Physics & Informatics Laboratories, NTT Research, Inc., Sunnyvale, CA, USA
Maya Okawa, Ekdeep S Lubana, Robert Dick, Hidenori Tanaka
Diffusion model; Emergence; Emergent capabilities; Science of deep learning; Mechanistic interpretability
Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task