He served in the United States Navy between 1944 and 1946. Then Olsen studied at the Massachusetts Institute of Technology (MIT). He earned a Bachelor of Science in 1950 and a Master of Science degree in 1952. Both degrees were in electrical engineering.