Matthew Hendrey

mrhendrey's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

updated a model 2 days ago

mrhendrey/X-ALMA-13B-Lora-Adapters

Updated 2 days ago

published a model 2 days ago

mrhendrey/X-ALMA-13B-Lora-Adapters

Updated 2 days ago

updated a model 3 days ago

mrhendrey/X-ALMA-13B-Pretrain-FP8-dynamic

Updated 3 days ago • 63

published a model 3 days ago

mrhendrey/X-ALMA-13B-Pretrain-FP8-dynamic

Updated 3 days ago • 63

updated a model about 1 month ago

mrhendrey/Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Feb 7 • 12

published a model about 1 month ago

mrhendrey/Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Feb 7 • 12

New activity in neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16 3 months ago

Model only outputs "!!!!!!!!!!"

1

#1 opened 3 months ago by

mrhendrey

updated a model 4 months ago

mrhendrey/Florence-2-large-ft-safetensors

Image-Text-to-Text • Updated Nov 14, 2024 • 36 • 1

New activity in microsoft/Florence-2-large 4 months ago

VRAM consumption when using GPU (CUDA)

3

#37 opened 9 months ago by

Sunjay353

Batch: inefficient memory

1

#50 opened 8 months ago by

SinanAkkoyun

New activity in neuralmagic/Llama-3.2-90B-Vision-Instruct-FP8-dynamic 6 months ago

Any chance your team is working on a 4-bit Llama-3.2-90B-Vision-Instruct-quantized.w4a16 version?

2

#1 opened 6 months ago by

mrhendrey