One can think of a matrix as describing a system of linear equations. That system has a unique non-trivial solution "exactly" when the determinant is not 0 ("non-trivial" meaning that the solution is not just all zeros).