Spaces:
Runtime error
Runtime error
Update README.md
Browse files
README.md
CHANGED
@@ -1,63 +1,14 @@
|
|
1 |
-
|
2 |
-
|
3 |
-
|
4 |
-
|
5 |
-
|
6 |
-
|
7 |
-
|
8 |
-
|
9 |
-
|
10 |
-
|
11 |
-
|
12 |
-
|
13 |
-
|
14 |
-
|
15 |
-
## Main Results
|
16 |
-
|
17 |
-
Audio Flamingo 2 outperforms prior SOTA models including GAMA, Audio Flamingo, Qwen-Audio, Qwen2-Audio, LTU, LTU-AS, SALMONN, AudioGPT, Gemini Flash v2, Gemini Pro v1.5, and GPT-4o-audio on a number of understanding and reasoning benchmarks.
|
18 |
-
|
19 |
-
<div align="center">
|
20 |
-
<img class="img-full" src="assets/af2_radar.png" width="300">
|
21 |
-
</div>
|
22 |
-
|
23 |
-
<div align="center">
|
24 |
-
<img class="img-full" src="assets/af2_table2.png" width="400">
|
25 |
-
</div>
|
26 |
-
|
27 |
-
## Audio Flamingo 2 Architecture
|
28 |
-
|
29 |
-
Audio Flamingo 2 uses a cross-attention architecture similar to [Audio Flamingo](https://arxiv.org/abs/2402.01831) and [Flamingo](https://arxiv.org/abs/2204.14198). Audio Flamingo 2 can take up to 5 minutes of audio inputs.
|
30 |
-
|
31 |
-
<div align="center">
|
32 |
-
<img class="img-full" src="assets/af2_arch.png" width="800">
|
33 |
-
</div>
|
34 |
-
|
35 |
-
## License
|
36 |
-
|
37 |
-
- The checkpoints are for non-commercial use only (see NVIDIA OneWay Noncommercial License). They are also subject to the [Qwen Research license](https://huggingface.co/Qwen/Qwen2.5-3B/blob/main/LICENSE), the [Terms of Use](https://openai.com/policies/terms-of-use) of the data generated by OpenAI, and the original licenses accompanying each training dataset.
|
38 |
-
- Notice: Audio Flamingo 2 is built with Qwen-2.5. Qwen is licensed under the Qwen RESEARCH LICENSE AGREEMENT, Copyright (c) Alibaba Cloud. All Rights Reserved.
|
39 |
-
|
40 |
-
|
41 |
-
## Citation
|
42 |
-
|
43 |
-
- Audio Flamingo
|
44 |
-
```
|
45 |
-
@inproceedings{kong2024audio,
|
46 |
-
title={Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities},
|
47 |
-
author={Kong, Zhifeng and Goel, Arushi and Badlani, Rohan and Ping, Wei and Valle, Rafael and Catanzaro, Bryan},
|
48 |
-
booktitle={International Conference on Machine Learning},
|
49 |
-
pages={25125--25148},
|
50 |
-
year={2024},
|
51 |
-
organization={PMLR}
|
52 |
-
}
|
53 |
-
```
|
54 |
-
|
55 |
-
- Audio Flamingo 2
|
56 |
-
```
|
57 |
-
@article{ghosh2025audio,
|
58 |
-
title={Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities},
|
59 |
-
author={Ghosh, Sreyan and Kong, Zhifeng and Kumar, Sonal and Sakshi, S and Kim, Jaehyeon and Ping, Wei and Valle, Rafael and Manocha, Dinesh and Catanzaro, Bryan},
|
60 |
-
journal={arXiv preprint arXiv:2503.03983},
|
61 |
-
year={2025}
|
62 |
-
}
|
63 |
-
```
|
|
|
1 |
+
---
|
2 |
+
title: Audio Flamingo 2
|
3 |
+
emoji: 🏃
|
4 |
+
colorFrom: yellow
|
5 |
+
colorTo: red
|
6 |
+
sdk: gradio
|
7 |
+
sdk_version: 5.15.0
|
8 |
+
app_file: app.py
|
9 |
+
pinned: false
|
10 |
+
license: apache-2.0
|
11 |
+
short_description: Audio Flamingo 2 Demo
|
12 |
+
---
|
13 |
+
|
14 |
+
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|