The role of the mechanical environment in defining tissue function, development and growth has been shown to be fundamental. Assessment of the changes in stiffness of tissue matrices at multiple scales has relied mostly on invasive and often specialist equipment such as AFM or mechanical testing devices poorly suited to the cell culture workflow.In this paper, we have developed a unbiased passive optical coherence elastography method, exploiting ambient vibrations in the sample that enables real-time noninvasive quantitative profiling of cells and tissues. We demonstrate a robust method that decouples optical scattering and mechanical properties by actively compensating for scattering associated noise bias and reducing variance. The efficiency for the method to retrieve ground truth is validated in silico and in vitro, and exemplified for key applications such as time course mechanical profiling of bone and cartilage spheroids, tissue engineering cancer models, tissue repair models and single cell. Our method is readily implementable with any commercial optical coherence tomography system without any hardware modifications, and thus offers a breakthrough in on-line tissue mechanical assessment of spatial mechanical properties for organoids, soft tissues and tissue engineering.