Androgen signalling, through the transcription factor androgen receptor (AR), is vital to all stages of prostate development and most prostate cancer progression. AR signalling controls differentiation, morphogenesis, and function of the prostate. It also drives proliferation and survival in prostate cancer cells as the tumour progresses; given this importance, it is the main therapeutic target for disseminated disease. AR is also essential in the surrounding stroma, for the embryonic development of the prostate and controlling epithelial glandular development. Stromal AR is also important in cancer initiation, regulating paracrine factors that excite cancer cell proliferation, but lower stromal AR expression correlates with shorter time to progression/worse outcomes. The profile of AR target genes is different between benign and cancerous epithelial cells, between castrate-resistant prostate cancer cells and treatment-naïve cancer cells, between metastatic and primary cancer cells, and between epithelial cells and fibroblasts. This is also true of AR DNA-binding profiles. Potentially regulating the cellular specificity of AR binding and action are pioneer factors and coregulators, which control and influence the ability of AR to bind to chromatin and regulate gene expression. The expression of these factors differs between benign and cancerous cells, as well as throughout disease progression. The expression profile is also different between fibroblast and mesenchymal cell types. The functional importance of coregulators and pioneer factors in androgen signalling makes them attractive therapeutic targets, but given the contextual expression of these factors, it is essential to understand their roles in different cancerous and cell-lineage states.