Micro-Raman spectra of concretions with and without fossils were measured in a nondestructive manner. The band position and full width at half maximum height (FWHM) of ν1-PO43−of apatite in the concretions were analyzed to investigate the origin of apatite. The analyzed concretions were derived from the Kita-ama Formation of the Izumi Group, Japan. The micro-Raman analysis showed that the apatites in the concretions were divided into two groups: Group W (wide FWHM group) and Group N (narrow FWHM group). The apatite belonging to Group W is suggested to be biogenic apatite originating from the soft body tissues of organisms because the Sr content is high and the FWHM is similar to that of apatite in bones and teeth of present-day animals. The other apatite belonging to Group N is considered affected by the diagenetic process because of its narrow FWHM and F substitution. These features of both groups were observed regardless of the presence of fossils or absence of fossils in the concretions. This Raman spectroscopic study suggests that the apatite at the time of concretion formation belonged to Group W but was changed to Group N by the substitution of F during the diagenesis process.