ig1
/

Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Image-Text-to-Text

text-generation-inference

Inference Endpoints

compressed-tensors

Model card Files Files and versions Community

Qwen2.5-VL-7B-Instruct-FP8-Dynamic / README.md

hekmon's picture

Update README.md

ea2371f verified 26 days ago

|

history blame contribute delete

363 Bytes

metadata

license: apache-2.0
language:
  - en
pipeline_tag: image-text-to-text
tags:
  - multimodal
library_name: transformers
base_model:
  - Qwen/Qwen2.5-VL-7B-Instruct

FP8 activation quantization performed with llm-compressor