Spire
Collection
Extending Tower to the speech modality
•
5 items
•
Updated
Spire is a 7B parameter decoder-only model with strong abilities in machine translation, automatic speech recognition, and speech translation. SpireBase was created by applying speech-centric continued pretraining to TowerBase-7B-v0.1, which was itself created by applying continued pretraining to Llama 2.
For further details, check the repository and the our arXiv preprint.