He was born in Vienna as a member of an artists family. His father Eduard von Borsody was a movie director, his uncle Julius von Borsody a set designer. His daughter Suzanne von Borsody is also an actress.