I am basically trying to align the behavior between DataPipe and DataLoader2: https://github.com/pytorch/data/blob/f629899aece23a15c155c7c7805b8db7a2bed2a7/torchdata/dataloader2/dataloader2.py#L176-L179