The "vectors" don't have to be vectors in the sense of things that have magnitude and direction. For example, they could be functions, matrices or simply numbers. If they obey the axioms of a vector space (a list of properties a vector space needs to satisfy), you can think of them as vectors and the theorems of linear algebra will still apply to them.