Recipe

slices:

  • sources:

    • model: sequelbox/DynamicFactor
    • layer_range: [0, 16]
  • sources:

    • model: sequelbox/DynamicFactor
    • layer_range: [8, 24]
  • sources:

    • model: sequelbox/DynamicFactor
    • layer_range: [17, 32]
  • sources:

    • model: sequelbox/DynamicFactor
    • layer_range: [25, 40]

merge_method: passthrough

dtype: float16

Downloads last month
14
Safetensors
Model size
20B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.