dodin

None yet

liked a model 7 days ago

microsoft/Florence-2-large

liked a model 5 months ago

Qwen/Qwen2-VL-7B-Instruct

liked a model 6 months ago

aiola/whisper-medusa-v1

None yet

dodin's activity

liked a model 7 days ago

liked a model 5 months ago

liked 2 models 6 months ago

replied to thomwolf's post 9 months ago

This comment has been hidden

reacted to thomwolf's post with ❤️🔥 9 months ago

Post

4889

Is is time for the open-source AI robots revolution 🚀?

With @haixuantao and @Leyo we’ve been playing with a low-cost DJI robot controlled by three local open-source AI models (Whisper, Idefics2, Parler-TTS - all Apache2) and orchestrated by Dora-cs.

Links to find all the hardware/software we used in the demo:
- robot control framework – dora-rs: https://github.com/dora-rs/dora
- speech-to-text model – whisper: openai/whisper-base
- vision-text model – Idefics2: HuggingFaceM4/idefics2-8b-AWQ
- text-to-speech model – ParlerTTS mini: parler-tts/parler_tts_mini_v0.1
- robot: https://dji.com/robomaster-s1
- code gist: https://gist.github.com/haixuanTao/860e1740245dc2c8dd85b496150a9320
- Larger codebase: dora-rs/dora-idefics2
- laptop/pc: any with a recent GPU card (our has a RTX 4090)

Enjoy!