Argonaute protein (AGO) in association with small RNAs is the core machinery of RNA silencing, an essential mechanism for precise development and defense against pathogens in many organisms. Here, we identified two AGOs in rice anthers, AGO1b and AGO1d, that interact with phased small interfering RNAs (phasiRNAs) derived from numerous long non-coding RNAs. Moreover, 3D-immunoimaging and mutant analysis indicated that rice AGO1b and AGO1d cell type-specifically regulate anther development by acting as mobile carriers of these phasiRNAs from the somatic cell layers to the germ cells in anthers. Our study also highlights a new mode of reproductive RNA silencing via the specific nuclear and cytoplasmic localization of three AGOs, AGO1b, AGO1d, and MEL1, in rice pollen mother cells.