MaRI: Material Retrieval Integration across Domains
Abstract
Accurate material retrieval is critical for creating realistic 3D assets. Existing methods rely on datasets that capture shape-invariant and lighting-varied representations of materials, which are scarce and face challenges due to limited diversity and inadequate real-world generalization. Most current approaches adopt traditional image search techniques. They fall short in capturing the unique properties of material spaces, leading to suboptimal performance in retrieval tasks. Addressing these challenges, we introduce MaRI, a framework designed to bridge the feature space gap between synthetic and real-world materials. MaRI constructs a shared embedding space that harmonizes visual and material attributes through a contrastive learning strategy by jointly training an image and a material encoder, bringing similar materials and images closer while separating dissimilar pairs within the feature space. To support this, we construct a comprehensive dataset comprising high-quality synthetic materials rendered with controlled shape variations and diverse lighting conditions, along with real-world materials processed and standardized using material transfer techniques. Extensive experiments demonstrate the superior performance, accuracy, and generalization capabilities of MaRI across diverse and complex material retrieval tasks, outperforming existing methods.
Community
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- MatCLIP: Light- and Shape-Insensitive Assignment of PBR Material Models (2025)
- CrossOver: 3D Scene Cross-Modal Alignment (2025)
- MF-VITON: High-Fidelity Mask-Free Virtual Try-On with Minimal Input (2025)
- Cross-Domain Semantic Segmentation with Large Language Model-Assisted Descriptor Generation (2025)
- Cross-domain Few-shot Object Detection with Multi-modal Textual Enrichment (2025)
- Zero-Shot Interactive Text-to-Image Retrieval via Diffusion-Augmented Representations (2025)
- Composed Multi-modal Retrieval: A Survey of Approaches and Applications (2025)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment:
@librarian-bot
recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper