Orphans are not even used for compact block reconstruction. And keeping the orphans a disconnected peer gave us opens up an avenue for attack: you can repeatedly send a bunch of nonsense orphans, and disconnect. This will cause the orphan pool to overflow and its effectiveness will decrease.