Hugging Face's logo

nvidia
/
Nemotron-4-340B-Reward

NeMo
English
nvidia
steerlm
reward model
Model card Files Community
8

Convertion to HF

#7
by lbathen - opened
Discussion
lbathen

Is there a way to convert this model to HF? I realize that NeMo has a few converters but the ones in the repo are only for base hf models, not for reward models. Thank you!

zhilinw
 NVIDIA org

We have a PR on going to convert Nemotron 340B to HF https://github.com/huggingface/transformers/pull/31699 and once that's merged, we will show how it can be used to run this reward model (using the same class) in addition to base/instruct models

lbathen

Outstanding @zhilinw !!!

lbathen

@zhilinw the above seems to have been merged, will nemo converters be modified to show how to export the RM to HF format?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment