Abdul Rahman bin Ya'kub was born in the village of Kampung Jepak, Bintulu, Sarawak on 3 January 1928 to a fisherman by the name of Tuan Wan Ya'kub bin Wan Yusuf and Siti Hajar binti Haji Mohd Tahir who was a housewife. Rahman's family left Bintulu and headed for Miri, hoping to gain access for better education. Rahman first attended a Malay school and then the Sekolah Anchi in Miri. His father, who wished that Abdul Rahman bin Ya'kub be given an Islamic education, attempted to send him to the Aljunied Arabic School in 1939, a decision that was opposed by his mother due to the outbreak of World War II. He then transferred to St. Joseph Miri, but his studies was cut short by the Japanese invasion. At a young age, he learnt the Japanese martial art Aikido and was able to also meet Morihei Ueshiba, the founder of Aikido.