Model that can generate both text and image as output
Greetings.Would it be possible to suggest models that can generate both text and images based on text only prompt.
2024-12-19T07:13:37Z
I think that your idea is part of the any-to-any model.And you can also generate text or images using two models that combined llm and diffusion model.But if we combine them that is any-to-any model. I know that there isn’t any model have this ability.It’s ongoing to develop.
2024-12-19T08:20:48Z
Thanks@Alanturner2for the feedback.So the only way I see now is to integrate the two models by passing the generated text to a diffusion model for which images are required.Then as a final step merge the text and images into a single output.
2024-12-19T08:42:43Z
Yeah that’s right.You can use LLM and diffusion as a base model .And than you can add encoder or decoder part for diffusion model.Than you can generate image and text at the same time.
2024-12-21T11:02:40Z
Alanturner2:eit truly looks fascinating mate!  I have not used anything like this before. Interesting
2024-12-31T00:15:42Z
There are many models that accept your condition.1.OpenAI GPT 4this is perhaps the most advanced option for multimodal capabilities.2.Google DeepMind’s Gemini3. Midjourney and stable diffusion4. CLIP and Artbreeder