Rare earth silicate phosphors of high quantum efficiency with a stable performance are promising materials in the fields of display and illumination. The grain sizes of products synthesized via the conventional solid-state reaction method are usually too large to satisfy the requirements of color cast and extraction efficiency in high-resolution light-emitting devices (LEDs). We designed a synthetic route and successfully fabricated rare earth silicate NaGd9Si6O26(NGSO) sub-microcrystals with a size ranging from 550 to 1200 nm. The reaction mechanism and optical properties were systematically investigated. The quantum efficiency of Eu3+-activated NGSO sub-microcrystals was about 36.6%. The LED encapsulated with these sub-microcrystals showed lower color deviation and higher lumen efficiency and lumen flux compared to that with NGSO fabricated using the conventional solid state reaction method.