|
--- |
|
license: other |
|
license_name: stabilityai-ai-non-commercial |
|
license_link: https://huggingface.co/stabilityai/stable-virtual-camera/blob/main/LICENSE |
|
tags: |
|
- image-to-video |
|
- novel-view-synthesis |
|
inference: false |
|
pipeline_tag: image-to-video |
|
extra_gated_prompt: >- |
|
By clicking "Agree", you agree to the [License Agreement](https://huggingface.co/stabilityai/stable-virtual-camera/blob/main/LICENSE) |
|
and acknowledge Stability AI's [Privacy Policy](https://stability.ai/privacy-policy). |
|
extra_gated_fields: |
|
Name: text |
|
Email: text |
|
Country: country |
|
Organization or Affiliation: text |
|
Receive email updates and promotions on Stability AI products, services, and research?: |
|
type: select |
|
options: |
|
- "Yes" |
|
- "No" |
|
--- |
|
|
|
# Stable Virtual Camera |
|
|
|
# **[Project Page](https://stable-virtual-camera.github.io/)** |
|
|
|
`Stable Virtual Camera` is a 1.3B generalist diffusion model for Novel View Synthesis (NVS), generating 3D consistent novel views of a scene, given any number of input views and target cameras. We encourage you to visit our [website](https://stable-virtual-camera.github.io/) for more visualizations. |
|
|
|
### Model Description |
|
|
|
- **Developed by**: [Stability AI](https://stability.ai/) |
|
- **Model type**: Transformer image-to-video model |
|
- **Model details**: This model was trained to generate 3D consistent novel views of a scene given any number of input views and target cameras. Users can specify the target camera trajectory freely, spanning across a large spatial range. Our model is capable of generating large viewpoint changes and temporally smooth samples. As a result, our samples maintain high consistency without requiring additional NeRF distillation, streamlining the view synthesis pipeline in the wild. Furthermore, we show that our method can generate high-quality videos lasting up to half a minute with seamless loop closure. |
|
|
|
### License |
|
|
|
- **Non-Commercial License:** Free for research and non-commercial use by organizations and individuals. Please refer to Stability AI's Non-Commercial License, available [here](https://huggingface.co/stabilityai/stable-virtual-camera/blob/main/LICENSE), for more information. |
|
|
|
### Model Sources |
|
|
|
- **Project Page**: [https://stable-virtual-camera.github.io/](https://stable-virtual-camera.github.io/) |
|
- **Paper**: [http://arxiv.org/abs/2503.14489](http://http://arxiv.org/abs/2503.14489) |
|
- **Blog**: [https://stability.ai/news/introducing-stable-virtual-camera-multi-view-video-generation-with-3d-camera-control](https://stability.ai/news/introducing-stable-virtual-camera-multi-view-video-generation-with-3d-camera-control) |
|
- **Code**: [https://github.com/Stability-AI/stable-virtual-camera](https://github.com/Stability-AI/stable-virtual-camera) |
|
- **Demo**: [https://huggingface.co/spaces/stabilityai/stable-virtual-camera](https://huggingface.co/spaces/stabilityai/stable-virtual-camera) |
|
- **Video**: [https://www.youtube.com/channel/UCLLlVDcS7nNenT_zzO3OPxQ](https://www.youtube.com/channel/UCLLlVDcS7nNenT_zzO3OPxQ) |
|
|
|
## Usage |
|
|
|
For usage instructions, please refer to our [GitHub repository](https://github.com/Stability-AI/stable-virtual-camera). |
|
|
|
### Intended Uses |
|
|
|
Intended uses include the following research and non-commercial uses: |
|
|
|
- Generation of artworks and use in design and other artistic processes. |
|
- Applications in educational or creative tools. |
|
- Research on reconstruction models, including understanding the limitations of these models. |
|
|
|
All uses of the model should be in accordance with our [Acceptable Use Policy](https://stability.ai/use-policy). |
|
|
|
### Out-of-Scope Uses |
|
|
|
The model was not trained to be factual or true representations of people or events. As such, using the model to generate such content is out-of-scope of the abilities of this model. |
|
|
|
### Contact |
|
|
|
Please report any issues with the model or contact us: |
|
|
|
- Security issues: [[email protected]](mailto:[email protected]) |
|
- Privacy issues: [[email protected]](mailto:[email protected]) |
|
|