Smaller model sizes to allow for speculative decoding

#8
by wrtn2 - opened

This is excellent, really impressive! Are there any plans to release smaller model sizes? For example 3B or 7B trained against the same data set could be useful for speculative decoding optimization. TIA

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment