When future Lister and Kochanski arrive alongside future Rimmer, the matter becomes so complicated that past Rimmer decides to accept it only as a hallucination and asks them all to leave him alone.
The arrival of future Lister and Kochanski alongside future Rimmer creates a complex scenario that past Rimmer chooses to dismiss as a hallucination, asking them to leave him alone.