πŸ₯ PathGenIC: Histopathology Image Report Generation with Multimodal In-Context Learning

PathGenIC is a multimodal in-context learning framework designed for automatic medical report generation from histopathology images. It enhances traditional vision-language models by integrating:

  • Nearest Neighbor: Dynamically retrieves similar cases for context.
  • Guideline: Follows structured diagnostic rules for consistency.
  • Feedback: Learns from mistakes to refine report generation.

We fine-tuned Quilt-Llava-v1.5-7b on HistGen Dataset, and achieves state-of-the-art performance with PathGenIC in BLEU, METEOR, and ROUGE-L scores.

πŸ”— GitHub Repository | πŸ“„ MIDL 2025 (Under Review)

πŸ‘‰ Download the pretrained model and put it at the model_weight folder.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for Casper666/PathGenIC

Finetuned
(1)
this model