enable activation checkpointing
#10
by
smangrul
- opened
This PR is meant to enable activation checkpointing
model = AutoModelForCausalLM.from_pretrained("microsoft/phi-2", checkpointing=True)
It gives me an Error "TypeError: PhiForCausalLM.init() got an unexpected keyword argument 'checkpointing'"
Hello @smangrul and @rungao2001 !
This will be updated once we integrate with the Phi implementation in HF.
Best regards,
Gustavo.
gugarosa
changed pull request status to
closed