README.md

---
license: apache-2.0
---

<p align="center">
    <b><font size="6">Dispider</font></b> 
<p>

<div align="center">
  
[💻Github Repo](https://github.com/Mark12Ding/Dispider)

[📖Paper](https://arxiv.org/abs/2501.03218)

</div>


## Quick Start
First download the checkpoints at the folder. 


**Important**: Modify the ``mm_compressor`` path in config.json to align with your local environment. The checkpoint for ``mm_compressor`` is located within a sub-folder of this repository.

For detailed evaluation, please refer to [Github repo](https://github.com/Mark12Ding/Dispider).






## ✒️ Citation
If you find our work helpful for your research, please consider giving a star ⭐ and citation 📝.
```bibtex
@article{qian2025dispider,
        title={Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction},
        author={Qian, Rui and Ding, Shuangrui and Dong, Xiaoyi and Zhang, Pan and Zang, Yuhang and Cao, Yuhang and Lin, Dahua and Wang, Jiaqi},
        journal={arXiv preprint arXiv:2501.03218},
        year={2025}
      }

@article{qian2025streaming,
        title={Streaming long video understanding with large language models},
        author={Qian, Rui and Dong, Xiaoyi and Zhang, Pan and Zang, Yuhang and Ding, Shuangrui and Lin, Dahua and Wang, Jiaqi},
        journal={Advances in Neural Information Processing Systems},
        volume={37},
        pages={119336--119360},
        year={2025}
      }
```