The violent side of Kanetaka was described in "Shoyuki" (Diary of FUJIWARA no Sanesuke) with the related episodes including having Umaya no toneri (stable keeper) at his residence beaten to death in 1013, and destroying and looting the house of Sanesuke's female servant in the following year.
藤原実資の日記『小右記』の中では粗暴な一面も描かれており、長和2年（1013年）に自家の厩舎人を殴殺させたこや、その翌年実資の下女の家を破壊、掠奪せしめたことなどが記述されている。