Hydrodechlorination (HDC) is a reaction that involves the use of hydrogen to cleave the C−Cl bond in chlorinated organic compounds such as chlorophenols and chlorobenzenes, thus reducing their toxicity. In this study, a palladium (Pd) catalyst, which is widely used for HDC due to its advantageous physical and chemical properties, was immobilized on alumina (Pd/Al) and graphene-based materials (graphene oxide and reduced graphene oxide; Pd/GO and Pd/rGO, respectively) to induce the HDC of 4-chlorophenol (4-CP). The effects of the catalyst dosage, initial 4-CP concentration, and pH on 4-CP removal were evaluated. We observed that 4-CP was removed very rapidly when the HDC reaction was induced by Pd/GO and Pd/rGO. The granulation of Pd/rGO using sand was also investigated as a way to facilitate the separation of the catalyst from the treated aqueous solution after use, which is to improve practicality and effectiveness of the use of Pd catalysts with graphene-based support materials in an HDC system. The granulated catalyst (Pd/rGOSC) was employed in a column to induce HDC in a continuous flow reaction, leading to the successful removal of most 4-CP after 48 h. The reaction mechanisms were also determined based on the oxidation state of Pd, which was observed using X-ray photoelectron spectroscopy. Based on the results as a whole, the proposed granulated catalyst has the potential to greatly enhance the practical applicability of HDC for water purification.