|
--- |
|
base_model: |
|
- wisdomik/Quilt-Llava-v1.5-7b |
|
tags: |
|
- medical |
|
- report |
|
- generation |
|
--- |
|
|
|
# 🏥 PathGenIC: Histopathology Image Report Generation with Multimodal In-Context Learning |
|
|
|
**PathGenIC** is a multimodal in-context learning framework designed for **automatic medical report generation from histopathology images**. It enhances traditional vision-language models by integrating: |
|
- **Nearest Neighbor**: Dynamically retrieves similar cases for context. |
|
- **Guideline**: Follows structured diagnostic rules for consistency. |
|
- **Feedback**: Learns from mistakes to refine report generation. |
|
|
|
We fine-tuned Quilt-Llava-v1.5-7b on **HistGen** Dataset, and achieves **state-of-the-art** performance with PathGenIC in BLEU, METEOR, and ROUGE-L scores. |
|
|
|
🔗 **[GitHub Repository](https://github.com/casperliuliuliu/PathGenIC)** | 📄 **MIDL 2025 (Under Review)** |
|
|
|
👉 Download the pretrained model and put it at the model_weight folder. |
|
|
