he would not be allowed into the library in the tower as a non-mage , and carthinal did not want him to go to the palace to work with lady randa without him being there , knowing the way they rubbed each other up the wrong way .