The word "palomar" is from the Spanish language, meaning "pigeon house". The name may be because of the many pigeons that can be seen in the spring and autumn months on Palomar Mountain, or it may be because of an old pigeon-raising building built there by the Spaniards.