a device and method of removing a rivet which has been installed on a work piece . the method includes clamping a hand held device having springs onto the work piece , engaging a drill with a drill bit of the hand held device , the springs applying a pre - load force to the drill bit , operating the drill , thereby causing the springs to apply an increased load force to the drill bit and causing the drill bit to drill into a button of the rivet , unclamping and removing the hand held device from the work piece , and using a compression tool to remove the rivet from the work piece . the compression tool includes a push out portion configured to push out the rivet , and a recess is disposed generally opposite the push out portion for catching the rivet as the rivet is pushed out .