Matthew Hendrey

mrhendrey's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

updated a model 18 days ago

mrhendrey/X-ALMA-13B-Lora-Adapters

Updated 18 days ago

published a model 18 days ago

mrhendrey/X-ALMA-13B-Lora-Adapters

Updated 18 days ago

updated a model 19 days ago

mrhendrey/X-ALMA-13B-Pretrain-FP8-dynamic

Updated 19 days ago • 136

published a model 19 days ago

mrhendrey/X-ALMA-13B-Pretrain-FP8-dynamic

Updated 19 days ago • 136

updated a model about 2 months ago

mrhendrey/Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Feb 7 • 19

published a model about 2 months ago

mrhendrey/Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Feb 7 • 19

New activity in neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16 4 months ago

Model only outputs "!!!!!!!!!!"

1

#1 opened 4 months ago by

mrhendrey

updated a model 5 months ago

mrhendrey/Florence-2-large-ft-safetensors

Image-Text-to-Text • Updated Nov 14, 2024 • 45 • 1

New activity in microsoft/Florence-2-large 5 months ago

VRAM consumption when using GPU (CUDA)

3

#37 opened 9 months ago by

Sunjay353

Batch: inefficient memory

1

#50 opened 9 months ago by

SinanAkkoyun

New activity in neuralmagic/Llama-3.2-90B-Vision-Instruct-FP8-dynamic 6 months ago

Any chance your team is working on a 4-bit Llama-3.2-90B-Vision-Instruct-quantized.w4a16 version?

2

#1 opened 6 months ago by

mrhendrey