Also, the unwieldy bureaucracy couldn't keep its loyalties straight, with the too-rapid turnover in rulers vying for Ashoka's throne.
People weren't loyal to the bureaucracy. 
There was no loyalty at all to the bureaucracy.