Neuroendocrine differentiation (NED) characterized by the expression of neuroendocrine markers, such as chromogranin A (CgA), is frequently observed in advanced prostate cancer (PCa), the prognostic significance of which is still controversial. Here we specifically addressed the issue of the potential prognostic value of CgA expression in advanced-stage PCa patients with distant metastases and its change over time from metastatic hormone-sensitive (mHSPC) to metastatic castration-resistant prostate cancer (mCRPC). CgA expression was assessed immunohistochemically in initial biopsies of mHSPC, as well as in second biopsies of mCRPC in sixty-eight patients, and its correlation with prognosis (together with conventional clinicopathologic parameters) was analyzed using the Kaplan–Meier method and Cox proportional hazard model. We found that CgA expression was an independent adverse prognostic factor for both mHSPC (CgA positivity ≥ 1%, HR = 2.16, 95% CI: 1.04–4.26,p= 0.031) and mCRPC (CgA ≥ 10%, HR = 20.19, 95% CI: 3.04–329.9,p= 0.008). CgA positivity generally increased from mHSPC to mCRPC and was a negative prognosticator. The assessment of CgA expression may help with the clinical evaluation of advanced-stage patients with distant metastases.