Hugging Face's logo

Yuvarraj
/
MASR

Model card Files Community
MASR / transformers /docs /source /en /model_doc /cpmant.md
Yuvarraj's picture
Yuvarraj
Initial commit
a0db2f9
preview code
|
raw
history blame contribute delete
1.83 kB

CPMAnt

Overview

CPM-Ant is an open-source Chinese pre-trained language model (PLM) with 10B parameters. It is also the first milestone of the live training process of CPM-Live. The training process is cost-effective and environment-friendly. CPM-Ant also achieves promising results with delta tuning on the CUGE benchmark. Besides the full model, we also provide various compressed versions to meet the requirements of different hardware configurations. See more

Tips:

This model was contributed by OpenBMB. The original code can be found here.

⚙️ Training & Inference

CpmAntConfig

[[autodoc]] CpmAntConfig - all

CpmAntTokenizer

[[autodoc]] CpmAntTokenizer - all

CpmAntModel

[[autodoc]] CpmAntModel - all

CpmAntForCausalLM

[[autodoc]] CpmAntForCausalLM - all